General Disclaimer 


One or more of the Following Statements may affect this Document 


• This document has been reproduced from the best copy furnished by the 
organizational source. It is being released in the interest of making available as 
much information as possible. 


• This document may contain data, which exceeds the sheet parameters. It was 
furnished in this condition by the organizational source and is the best copy 
available. 


• This document may contain tone-on-tone or color graphs, charts and/or pictures, 
which have been reproduced in black and white. 


• This document is paginated as submitted by the original source. 


• Portions of this document are not fully legible due to the historical nature of some 
of the material. However, it is the best reproduction available from the original 
submission. 


Produced by the NASA Center for Aerospace Information (CASI) 




- 1 6 1 fab) TLN- tCOSYSTIiM STULY BlUdi 
faet>oi.t (LocRhiioa fah>jiiieeL luq <jud bdiiuqeaeut) 
qo p MC A0‘j/rtJ: AOI C faC Ufa 


N8^-ii2b^0 


Unci as 

(iJ/4J OOldo 









TEN- ECOSYSTEM STUDY 


« 


M 


9 


Pinal Report 



Prepared under the direction of 


A. V. Mazade 


Under Contract NAS 9-15800 
For 


NATIONAL AERONAUTICS AND SPACE ADMINISTRATION 
Lyndon B. Johnson Space Center 
Houston, Texas 77058 


Supporting the 

U. S. DEPARTMENT OP AGRICULTURE FOREST SERVICE 


Nationwide Forestry Applications Program 
1050 Bay Area Boulevard 
Houston, Texas 77058 

|Trtotoarai>nii m M gttBwi 
£80S Ddta CiirtW. , 


StaaMfcai. 


August 1981 


LEMSCO- 13491 


I. n««ort No. 


3. Oomwwni AeMNon No, 


3. Ridoiont't Coutoi No. 


4, Titit ind SuMitto 


TBN-BCOSYSTBI STUDY 


5, Ntport Oilt 
August 1981 


S, PiHorminf OffoniiMion CoS» 


7, Auihorli) 

Proporod undor tho dirootion of 
A. V. Hozodo 


0, Arformint Ortoolutkin N«nt ond Addroa 

Lookhoad Englnoorlng and Monogomont So.rvlcos CoapAny, Xnc« 
1830 NASA Rd. 1 
Houston, Taxas 77058 


13. Spomorint Aftncy Nona m\6 Addroa 

National Aoronautics and Spacs Administration 
Lyndon B. Johnson Spacs Cantor 
Houston, Taxas 77058 


IS. Supplonamay Nom 


8, forformint Or|w>ltation Naport No. 
LIM8CO- 13491 


10. Work Unit No. 
63-2457-2543 


11, Coniroct or Crartt No. 
NAS 9-15800 


13, Typo of Noport aid Porisd Covaod 
Pinal Raport 


14. Speraorinp Apncy Codo 


18, AOttroct 

Ramota sansing mathodology davalopad for tho Nationwida Forastry Applications Program 
utilizad computor data p’rocesking prucodurc'i for parfoming Invantorlas frotn satallita 
imagary. In 1976, tho U»3i D«., artmont of A.|riculturo Forost Sorvico and tha National 
Aaronautics and Spaco Actniiiistration at tha Lyndon B. Johnson Spaca Cantor, in a joint 
of fort, craatad tha Tan-Eoosysf;am Study (TES) to tost the processing procoduras in an 
intormadiata-sized appl icatlon study, Tha results of TES indicate that Landsat 
multlspactral imagery and asscciated automatic data processing tochniquas can ba used to 
distinguish softwood, hardwood, grassland, and water and maka inventory of thane classes 
with an accuracy of 70 percent or batter. The technical problems encountered during tha 
TES and the solutions and insights to those problems are discussed, Tha TES axparianca is 
useful in planning subsequent inventories utilizing ramota sensing technology, 


17. K«y Worde jSuggMtsd by AuihorliH 
Type Separability 
Simulated inventory 
Automatic data processing 
Accuracy assessment 

18. Olivibution Siatamcni 

19. Sacurity Qamif, (of tM< rafort) 

30. Sacurity Clamif. (of thit pagal 




31. No. of PapM 


*for lato by tftt Nitional Ttchntesl tnformnlon Sorvict, Springfitid, Virginia 32161 


JSC form 1424 (Pm Nav 7S) 


NASA — me 




















PRECEDWG PAGE ^LANK NOT FILMED 


PREFACE 


The Ten Ecosyeteme Study was a cooperative effort of the National Aeronautics 
and Space Admin istj^ation and the U.S* Department of A 9 rlculture Forest Service, 
Nationwide Forestry Applications Program. 

The work which is the subject of this document was performed within the Earth 
Resources Applications Division, Space and Life Sciences Directorate, at the 
Lyndon B. Johnson Space Center, National Aeronautics and Space Administration. 
Under Contract NAS 9-15800, personnel of Lockheed Engineering and Management 
Services Company, Inc., performed the tasks v^lch contributed to the comple- 
tion of this research. 


Many people contributed to the Ten-Ecosystem Study research and reporting. 


This group, the true authors of this 

R. H. Almond 

D. L. Amsbury (NASA) 

G. K. Arp 

R. D. Dillman 

I. E. Duggan (FS) 

F. B. Eav 

W. H. Bchert 

B. F. Edwards 
L. R. Hall 

J. S. Huang 

E. P. Kan 

A* G. Kerber 
D. R. King 

H. Parkhurst 
J. C. Prill 

C. A. Underwood 
J. F. Ward 

J. E. Weaver 

S. S. Yao 


report. Includes i 

M. F. MCKay, Technical Writer and Editor 

I. P. Sartorlus, Editor 

Guidance 

R. E», Joosten (NASA) 

F. F. Weber (FS) 


preceding page blank not filmed 


CONTENTS 

Sflction 


1. PURPOSE OF THE TEN-ECOSySTEM STUDY ... 

*\ BACKGROUND ON THE NATIONWIDE FORESTRY 
APPLICATIONS PROGRAM 

3. SITE SELECTION . . 

3.1 RATIONALE 

3 . 2 SITE DESCRIPTIONS 


3.2. Gtand County. Col o r aido (Site I) . •••....• i. • 

3.2. 2 County. Pennsylvania (Site II) . 

3. 2*3 .. jStm Louis County. Minnesota {Site III) ....*...... 

3«,2.4 . ^iSndoVal County. New Mexico (Site IV) 

3 . 2 . 5 ,, /Kershaw County. South Carolina (Site V) . 

3.2.6 Fort Yuk<>n. Alaska ( Site VI) ..................... 

3.2. 7 yW^d County. Colorado (Site VII ) « 

3. 2;^, . Grays Harbor County. Waablngton (Site VIII) . ..... 

3.2.9 Washington County. Missouri (Site IX) ............ 


4 • ANALxSIS PROCEDURES . 

4.1 SEQUENCE OF ACTIVITIES. 

4.2 EXPLANATION OF PROCEDURES. . ......... ................... . 

4.2.1 Preliminary Image Analysis . 

4.2.2 Field survey . 

4.2.3 Registration . 

4. 2 ; 4 Type Separability Study . ................ <4........ 

4.2.5 Simulated’ Inventory Study .. . ..................... 

4.2.6 Map Production . ...................... . . .......... 


Page 

1 

2 

3 

3 

3 

4 

4 

5 

6 
6 
6 
6 
6 
7 
7 
7 
7 
7 
9 
9 

11 

12 

12 


vii 


Section 


Page 


5. RESULTS 14 

5.1 TYPE SEPARABILITY 14 

5.2 SIMULATED INVENTORY STUDY 14 

5.3 COSTS 18 

5.3.1 Dltect Coets for Research . 21 

5.3.2 Direct Costs for Applicatione . 21 

5.3.3 C omparison of Costa With Site Feeturee. 21 

5.3.4 Total Project Costs 22 

5. ACCURACY ASSESSMENT 22 

6.1 TYPE SEPARABILITY STUDY 22 

6.2 SIMULATED INVENTORY STUDY... 23 

7. TECHNICAL PROBLEMS ..'. 31 

7.1 SITE-SPECIFIC PROBLEMS. * 31 

7.1.1 Grand County. Colorado (Site I) .. 31 

7.1.2 Warren County# Pennsylvania (Site II) 31 

7.1.3 St. Louis County. Minnesota (Site III) .. 31 

7.1.4 Sandoval County. New Mexico (Site IV 31 

7.1.5 Kershaw County, South Carolina (Site V) 32 

7.1.6 Fort Yukon# Alaska ( Site VI ) 33 

7.1.7 Weld County. Colorado (Site VII) 33 

7.1.8 Grays Harbor County# Washington (Site VIII). ..... 33 

7.1.9 Washington County. Missouri (Site IX) 33 

7.2 PROCEDURAL PROBLEMS * 34 

7.2.1 Storage and Display of Data 37 

7.2.2 Registration . 37 


viii 


f 


Section P«ge 

7.2.3 System Parameters 38 

7.2.4 clagalflcatlon Flexibility . 38 

7.2.5 Accuracy Assesament 38 

8. SUMMA RY 39 

REFERENCES 40 

BIBLIOGRAPHY 41 

Appendix 

A. CLASSIFICATION MAPS.... 45 

B. proportion estimates...) 59 

C. DETAILED COST TABLES FOR THE TEN- ECOSYSTEM STUDY. 61 

D. SUMMARY OF CLASS PROPORTION ERRORS 69 

E. REGRESSION ESTIMATES.... 75 

P. COMPARISONS OF TEN- ECOSYSTEM STUDY RESULTS WITH 

PUBLISHED FIGURES 81 


if 

i\ 

\\ 

if 

rf 

i] 


ix 



PRECEDING PAGE BLANK NOT FILMED 


TABLES 

Table Page 

I TES STUDY SITES... 5 

II PERCENTAGE OF CORRELATION OF EIGHT INTERPRETED 

LANDSAT IMAGES WITH AERIAL PHOTOGRAPHS ” SITE IX 
(WASHINGTON COUNTY, MISSOURI)., 8 

III ACQUISITION DATE OF LANDSAT IMAGERY FOUND BEST 

FOR SEPARABILITY PURPOSES 17 

IV PROPORTION ESTIMATES FOR SITE III, 

ST. LOUIS COUNTY, MINNESOTA 18 

V CLASSES DEVELOPED BY REANALYSIS OP SITE IV, 

GANDOVAIi COUNTY, NEW MEXICO $ 18 

VI COMPARISON OP ORIGINAL INVENTORY PROPORTIONS 
AND REANALYSIS RESULTS FOR SITE IV, 

SANDOVAL COUNTY, NEW MEXICO. 18 

VII TRAINING FIELD CLASSIFICATION ACCURACIES FOR THE 
LEVEL II SEPARABILITY STUDY AT SITE t/1 

( FORT YUKON, ALASKA) . . . . 23 

VIII TRAINING F.IELD CLASSIFICATION ACCURACIES FOR THE 
LEVEL III SEPARABILITY STUDY AT SITE VI 

(FORT YUKON, ALASKA)................... 23 

IX SUMMARY OF PCC CALCULATIONS FOR SITE IX, 

WASHINGTON COUNTY, MISSOURI... 26 

X PERCENTAGE OP CORRECT CLASSIFICATION WITH 

CONFIDENCE INTERVAL 27 

XI SUMMARY OP CLASS PROPORTION ERRORS FOR SITE IX, 

WASHINGTON COUNTY, MISSOURI 27 

XII REGRESSION ESTIMATES OF PROPORTIONS AND 

ASSOCIATED PRECESION FOR SITE III, 

ST. LOUIS COUNTY, MINNESOTA 28 

XIII COMPARISON BETWEEN INVENTORY CLASSIFICATION 

PROPORTIONS AND FOREST SERVICE AND SOIL 
CONSERVATION SERVICE (SCS) ACREAGE 
PROPORTIONS FOR SITE V, KERSHAW COUNTY, 

SOUTH CAROLINA........ 30 

\ 

xi 


” . 


Table Page 

XIV CLASSIFICATION ACCURACY OP SEPARABILITY 

TRAINING FIELDS USING INVENTORY 

SIGNATURES . 30 

XV PROBLEHS SPECIFIC TO EACH SITE 37 

E-I PROPORTION ESTIMATES FOR SITE I, GRAND 

COUNTY, COLORADO...,...., 50 

B-II PROPORTION ESTIMATES FOR SITE II, WARREN t 

COUNTY, PENNSYLVANIA*. 59 

B-III PROPORTION ESTIMATES FOR SITE IV, SANDOVAL 

COUNTY, NEW MEXICO.... 59 

B-IV PROPORTION ESTIMATES FOR SITE V, KERSHAW 

COUNTY, SOUTH CAROLINA.,.. 59 

B-V proportion ESTIMATES FOR Sll® VI, 

FORT YUKON, ALASKA....................... 60 

B-VI PROPORTION ESTmkTES FOR SITE VII, 

WELD COUNTY, COLORADO. ......... 60 

B-VII PROPORTION ESTIMATES FOR Sl’SE VIII, 

GRAYS HARBOR COUNTY, WASHINGTON........... 60 

B-VI II PROPORTION ESTIMATES FOR SITE IX, 

WASHINGTON COUNTY, MISSOURI........ 60 

C-I ESTIMATED DIRECT COSTS FOR RESEARCH 61 

C-II ESTIMATED RESEARCH DIRECT COSTS PER UNIT AREA... 62 

C-III ESTIMATED DIRECT COSTS FOR APPLICATIONS* , . 63 

C-IV ESTIMATED APPLICATIONS DIRECT COST PER UNIT AREA........ 63 

C-V SAMPLE MODEL AND DATA SOURCE TABLE FOR 

DETERMINING TOTAL PROJECT COST.. 64 

C-VI RESULTS TABLE FOR TOTAL RESEARCH AND 

APPLICATIONS FOR THE MEAN OF TES SITES 65 

D-I SUMMARY OF CLASS PROPORTION ERRORS FOR 

SITE I, GRAND COUNTY, COLORADO........... 69 

r 

xil 


Tabl« Pag* 

D-II SUMMARY OF CLASS PROPORTION ERRORS FOR SITE II, 

WARREN COUNTY, PENNSYLVANIA.......... 69 

D-III SUMMARY OF CLASS PROPORTION ERRORS FOR SITE III, 

ST. LOUIS COUNTY, MINNESOTA 70 

D-IV SUMMARY OP CLASS PROPORTION ERRORS FOR SITE IV, 

SANDOVAL COUNTY, NEW MEXICO 7l 

D-V SUMMARY OP GLASS PROPORTION ERRORS FOR SITE V, 

KERSHAW COUNTY, SOUTH CAROLINA 72 

D-VI SUMMARY OP CLASS PROPORTION ERRORS FOR SITE VI, 

FORT YUKON, ALASKA 72 

D-VII summary OF CLASS PROPORTION ERRORS FOR SITE VII, 

WELD COUNTY, COLORADO. . 73 

D-VIII SUMMARY OF CLASS PROPORTION ERRORS FOR SITE VIII, 

GRAYS HARBOR COUNTY, WASHINGTON 74 

E-I REGRESSION ESTIMATE OF SOFTWOOD ACREAGE FOR SITE 1, 

GRAND COUNTY, COLORADO. 75 

E-II REGRESSION ESTIMATES OP PROPORTIONS AND ASSOCIATED 

PRECISION FOR SITE IV, SANDOVAL COUNTY, NEW MEXICO 75 

B»III REGRESSION ESTIMATES OF PROPORTIONS AND ASSOCIATED 

PRECISION FOR SITE VI, FORT YUKON, ALASKA 76 

E-IV REGRESSION ESTIMATES OP PROPORTIONS AND ASSOCIATED 

PRECISION FOR SITE VII, WELD COUNTY, COLORADO.,... 77 

E-V REGRESSION ESTIMATES OF PROPORTIONS AND ASSOCIATED 

PRECISION FOR SITE VIII, GRAYS HARBOR, WASHINGTON 78 

E-Vl REGRESSION ESTIMATES OP PROPORTIONS AND ASSOCIATED 

PRECISION FOR SITE IX, WASHINGTON COUNTY, MISSOURI...... 79 

P-I SOFTWOOD AREA ESTIMATES AND COMPARISION FOR SITE I, 

GRAND COUNTY, COLORADO 81 

P-II HARDWOOD AREA ESTIMATES AND COMPARISON FOR SITE II, 

WARREN COUNTY, PENNSYLVANIA 82 

F-III COMPARISON BETWEEN ADP CLASSIFICATION AND MEASURED 
FEATURES FOR TOWNSHIP 17 NORTH, RANGE 2 EAST, 

SITE IV, SANDOVAL COUNTY, MEW MEXICO......... 62 

F-IV . SIMULATED INVENTORY VERSUS WASHINGTON COUNTY 

STATISTICS 83 


xiii 


preceding page blank not filmed 

FIGURES 

Figure Page 

1 Forest and grassland ecosystems in the 

United states* ••••••••• 4 

2 Sample checklist completed in the field* 10 

3 Classification of quadrant 2 of Site II 
(Warren county, Pennsylvania) before and 

after applying GETMIX/CLEkH * *•....*****......*»..***•*•* 13 

4 Classification map for Site V, 

Kershaw County, South Carolina* 15 

5 Classification twiv for Site iv, 

Sandoval County, i^ew Mexii^j* *••*•*••**. ..*.*•.,. •****.•• 19 

6 a?wo‘-stage sampling strategy. »..•**...*.•*...,**.•**.***. 24 

7 *IES ev/aluation procedure 26 

8 Graphic display of class proportion estimates 

for Site IX (Washington County, Missouri). ...***** 28 

9 Landsat full-frame image including Warren County, 

Pennsylvania, acquired in September 1972 32 

10 Pinyon- juniper with exposed soil and rock — Site IV 

( Sandoval County, New Mexico) 33 

11 True shadow and apparent shadow effects in 

hilly terrain • 34 

12 Classification map for Site IX 

(Washington County, Missouri) 35 

A-1 Classification map for Site I, 

Grand County, Colorado 47 

h-2 Classification map for Site II, 

Warren County, Pennsylvania* ••..*•.*•••.••.•.*•..*••.. ** 49 

A-3 Classification map for Site III, 

dt . Louis County, Minnesota 51 

A-4 Classification map for Site VI, 

Fort Yukon, Alaska* ....... 53 


XV 


Fi9UK‘<a F»9« 

A-5 CXattsificatlon map for Site VII> 

Weld County f Colorado 55 

h-B ClaaeiCication map for Site VIXI# 

Graya Harbor County# Waehington 57 

C-1 Comparison of direct coat for aita analyaia 

with relative analyat ADP experience* 55 

C-2 Comparieon of direct coat for aite analyaia 

with proportion of Coraat in aite. 66 

C<-3 Comparison of direct coat for aite analyaia 

with proportion of hardwood in aite... 66 

C-4 Comparison of direct cost for aite analyaia 

with proportion of sof t%food in aite 67 

C»5 Comparison of direct cost for site analyaia 

with proportion of grassland or tundra in site.......... 67 


ADP 

ASE 

ERDA 

ERIPS 

ERIM 

GMP 

Image 100 
JSC 

Landsat 

LEG 

MSS 

NASA 

NPA 

NSCS 

PCC 

pixel 

PSU 

rms 

SCS 

SE 

SSDA 

SSU 

TBS 

TRICPS 

USDA 


ACRONYMS 

automatic data prooatsing 

adjusted standard e^ror 

Energy Research Deve] >pment Agency 

Earth Resources Interactive Processing System 

Environmental Research Institute of Michigan 

Geographic Mapping Program 

General Electric Interactive Multlspectral Image Analysis 
System, Modcx 100 

Xtyndon B, Johnson Space center 

NASA land observatory satellite 

Lockheed Electronics Company, Inc./ name changed in 1980 to 
Lockheed Engineering and Management Services Company, Inc* 

multlspectral scanner 

National Aeronautics and Spcoe Administration 

Nationwide Forestry Applications 

National Site Classification system 

percentage of correct classification 

picture element 

primary sampling unit 

root mean square 

Soil Conservation Service 

standard error 

Sequential Similarity Detection Algorithm 
secondary sampling unit 
Ten-Ecosystem Study 

Tri-County Pilot Study 

U*S. Department of Agriculture 


1. PURPOSE OF THE TEN-ECOSYSTEM STUDY 


To explore the feasibility of 
using Landsat multispectral imagery 
and associated automatic data proc- 
essing techniques to inventory for- 
est and grassland resources, NASA's 
Lyndon B. Johnson Space Center and 
the USDA's Forest Service joined 
together in 1976 to develop the Ten- 
Ecosystem Study, ^ By dividing the 
continental United States into 10 
broadly defined ecological communi- 
ties and examining the similarities 
and diflferences among thes^ ecosys- 
tems, this study could build on the 
successes of more localized studies 
and serve as a prelude to larger 
scale applications. 


The experimental design of the 
Ten-Ecosysteiii study can be seen as 
having two principal and sequential 
components. The first, called a 
type separability study, was to 
determine at what level of detail 
forest and grassland features 
(whether general categories such as 
softwood and hardwood or more 
specific groups such as pine and 
spruce) could be distinguished on 
the basis of their Landsat spectral 
respotjses. A related objective was 
to determine the season providing 


the greatest separability. The 
subsequent principal component, 
called the simulated inventory 
study, was to develop a spectral 
signature for each indicated cover 
type from the indicated season using 
only 10 percent of the site and then 
extend this signature across the 
site to inventory that type. The 
classification map resulting from 
the simulated inventory study was to 
be evaluated by comparison with 
interpreted aerial photographs. 

To provide comparable results for 
the 10 diverse ecological situa- 
tions, the initially chosen proce- 
dures (ref. 1) were applied uni- 
formly to all sites, thus precluding 
the implementation • " new analytical 
procedures that ^d desirable to 
project personnel. Resource con- 
straints (project vjas limited a 
17-man-year-equivalent effort) pre- 
vented the parallel assessment of 
such possibly improved techniques. 
However, the technical problems that 
arose in the Ten-Ecosystem Study and 
the insights into their solutions 
gained by the TES staff afford expe- 
rience useful in planning subsequent 
resource inventories utilizing re- 
mote sensing technology. 


1 

Definitions: 

Landsat — the series of land observ- 
atory satellites launched by NASA 
beginning in 1972, originally named 
Earth Resources Technology Satellite 
(ERTS) . 

Automatic data processing — • abbrevi- 
ated ADP. 


NASA — National Aeronautics and 
Space Adminig*' /ation. 

Lyndon B. J"«',inson Space Center 
hereinafter called JSC. 

USDA — U.S. Department of Agri- 
culture. 

Ten-Ecosystem Study abbreviated 

TES. 


2. BACKGROUND ON THE NATIONWIDE FORESTRY 

APPUCATIONS PROGRAM 


The Ten-'Ecosystem Study was one 
aspect of a larger joint effort of 
the Forest Service and NASA/ JSC » 
This larger effort, established in 
1972 as a regional effort called the 
Forestry Applications Project, was 
expanded in 1976 to become the 
Nationwide Forestry Applications 
(NPA) Program. The program has been 
given the responsibility of develop- 
ing the remote sensing methodology, 
£irst, to make large area forest and 
grassland inventories; second, to 
assess the impact of insect and 
disease on forest stands'; and, 
third, to monitor the environmental 
effects of management practices. 
The NFA Program is responsive to the 
needs of the Service through- 
out the country. 

The Forest Service receives its 
direction through Federal legisla- 
tion, notably through two recent 
acts of Congress. Enacted in 1974, 
the Forest and Rangeland Renev;able 
Resources Planning Act required the 
nationwide assessment of timber and 
range resources and the planning of 
long-range programs to meet future 
needs for these resources. The 
National Forest Management Act of 
1976 in effect amended the previous 
act and extended the national for- 
estry leadership role of the Forest 
Service beyond the management of the 
National Forest System to include 
natural resources research and 
cooperative forestry assistance to 
state and private landowners.^ 

2 ■ ' " ' ' ' ” 

“The Natxonal Forest System con- 
tains 750 000 square kilometers (187 
million acres) . The forest and 
rangeland resources of the United 
States would be sevesral times that 
area . 


Between 1972 and 1975, the For- 
estry Applications Project conducted 
a number of localized studies, the 
largest of which was the 1975 Tri- 
County Pilot Study (TRICPS). TRICPS 
(ref. 2) analyzed an area of 6500 
square kilometers (1 600 000 acres) 
using ADP and conventional photo- 
interpretation methods. The feasi- 
bility of the techniques used in 
these studies was supported by the 
conclusions of other researchers. 
For example, a study on forest and 
grassland in souths-^.-:: Texas re- 
ported ADP classification accuracies 
of 91, 70, and 85 percent for soft- 
wood, hardwood, and grassland, 
respectively (ref. 3). 

On the basis of these results, 
the Forestry Applications Project 
developed a set of computer data 
processing procedures for performing 
inventories from satellite imagery 
and decided to test these procedures 
in an intermediate-sized application 
study. This decision was given 
impetus by the 1974 Renewable 
Resources Planning Act. 

The Ten-Ecosystem Study in test- 
ing a uniform set of remote sensing 
data analysis procedures over a wide 
variety of physiographic and ecolog- 
ical conditions has provided a sig- 
nificant benchmark for the Nation- 
wide Forestry Applications Program. 
This experiment has provided new 
information on the accuracy and 
efficiency of the tested procedures. 

Based on peer reviews of the Ten- 
Ecosystem Study in September 1977 
and September 1978, research has 
been undertaken to extend the 
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utility of TES procedures. This 
re&cicirch provided for a smooth 
transition into the Multiresource 
Inventory Methods Pilot Study. The 
goal of this large-scale project is 
to test, evaluate, and transfer 


significant new remote sensing 
technology to the Forest Service, in 
support of renevrable resource 
inventories and the land management 
planning process mandated by the 
1976 National Forest Management Act. 


3. SITE SELECTION 


3.1 ratkonale 

This study was intended to cover 
forest types cinoughout the United 
States. The Society of American 
Forester^' described about 150 U.S. 
forest types, distinguished as to 
composition and development due to 
ecological factors (refs. 4 and 5), 
These ecological factors are pri- 
marily temperature and rainfall, 
modified by soils, slope, and 
aspect. Vegetation in the contigu- 
ous 48 states shows a belted pattern 
based on these ecological factors, 
with East-West belts corresponding 
to latitude in the eastern United 
States and North-South belts corres- 
ponding to elevation in the western 
United States. Therefore, this 
study grouped forest types iitto eco- 
systems based on this pattern of 
temperature and rainfall ( >'ee 
fig. 1) . Ten ecosystems were gener- 
alized from the map of forest types 
by Shantz and Zon (ref. 6) . The 
number 10 was chosen as providing 
sufficiently detailed information to 
the Forest Service and as being man- 
ageable within the limited resources 
of the program. 

One site was chosen to represent 
each of the 10 ecosystems. Selec- 
tion criteria included the following 
considerations. The site should 
include a national forest to enable 
exchange of information with Forest 


Service personnel. The site should 
have 80-percent coverage by NASA 
photography to ensure a uniform 
ground- truth base. And, of course, 
the site needed to have adequate 
Uandsat coverage providing the data 
to be analyzed. To avoid transition 
areas, all but one of the sites were 
located well within the defined 
boundaries of the ecosystem. The 
exception was Site V (Kershaw 
County, South Carolina), where the 
fall line^ provided a boundary 
between two ecosystems. Thus, 9 
sites were able to represent 10 
ecosystems. The site locations are 
shown on figure 1, 

3.2 SITE DESCRIPTIONS 

Table I presents a summary de- 
scription of the nine study f,ites. 
The paragraphs that follow provide 
brief narrative descriptions of the 
distinguishing characteristics of 
each site. 


^A line joining the waterfalls on 
numerous rivers that marks the point 
where each river descends from the 
upland to the lowland and the limit 
of the navigability of each river. 
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3.2.1 Grand County, Colorado (Site I) 

The first TES site studied is 
situated in the southern Rocky Moun- 
tain'. in Grand County, Colorado. 
The topographically diverse site is 
of high elevation (to 4000 meters or 
13 000 feet), with moderate summer 
temperatures and very cold winter 
temperatures. Rainfall averages 
from 25 to 41 centimeters (10 to 


16 inches) per year at the study 
site. The Rocky Mountain conifers 
in the site consist of lodgepole 
pine, subalpine fir, and Engelmann 
spruce. The dominant species are 
determined by the altitude. 

3.2.2 Warren County, Pennsylvania (Site II) 

Warren County, Pennsylvania, con- 
stitutes the second site. This 
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TABLE I.~ TES STUDY SITES 


lit* 

nunber 

lit* 

loo.tlon 

sooayatam 

rapraaantad 

Cantar ooordlnataa 

National foraat 
or graaalanda 

Klavatlon 


liatltuda, 

north 

tongitud*# 

w«at 

Natara 

p*at 

ipaoiaa 

I 

(Sr.nd county) 
Colorado 

Rodky (**itntaln 
Coni tot 

39*55» 

105*52' 

Arapaho National 
poreat 

2400 to 4000 

8000 to 13 000 

Haatarn yallow plna. 
Couglaa (Ir. }arah. and 
waatarn whlta plna 

II 

U*rr*n Countyi 
Nnn*yiv*nU 

Nortilan' Hardwood 

41M4* 

7»<14' 

hllagheny National 
Poraat 

340 to 400 

1100 to 1000 

laaoh. blrehi aapla. oak. 
and hl'okory 

m 

It. Loula 

county. 

Mlnnaaota 

Northarh Conlfar 

48»15> 

92«05* 

buparlot National 
rotaat 

370 to SSO 

1200 to 1800 

81a«k and whlta apruoa. 
balaaa Jir. plna. aapan. 
and blroh 

IV 

flandoyni 

Count/i 

Hsxico 

yinyon-Junlpar 

SS*4S* 

106*37* 

Santa P« National 
Poraat 

2000 to 1440 

<500 to 11 300 

Plnyon, Junlpar. alnvlf 
laa( plna. Oouglaa fir. 
aorub oak. and aa«abruah 

V 

K*r*b«w County# 
South C*roUn« 

Pak-Plno 

34*2P' 

80*35' 

Nona 

30 to ISO 

100 to 600 

Oak. htekory. and aoutharn 
yallow pint 


Kerahaw County. 
South CaroUnn 

Southeaatarn Pina 

34*J0* 

80*35' 

None 

30 to ISO 

100 to 600 

loutharn yallow plna. 
bottoaland oak. tupeio. 
awaat gun. hlakory. and 
bald oypraaa 

VI 

i'ort Yukon^ 

Alaska 

Doreal 

66M1* 

143*25' 

Porcupine National 
Foceat (propoaed) 

170 to 850 

550 to 2800 

Black and whlta apruca. 
blroh. aapan. poplar, and 
willow bruah 

VII 

Weld County# 
Colorado 

Sraaaland 

4QM$' 

104*20' 

Pawnaa National 
craaalandB 

1400 to 1840 

4580 to 6050 

BUttalo grain, blua graoa. 
hairy grama, aaltgraaa. 
aagabruah. masqulta. and 
aouthwaatarn broadlaaC 

traaa 

vu: 

Grays K*rbor 

County# 

Washln 9 ton 

Pacific Coasc 

47*22' 

123* 43 » 

Olympic National 
Foreat 

0 to 2000 

0 to 6700 

Douglaa {Ir Icoaatal {oral, 
wcatarn rad Cadar. oltka 
apruoa. radwood. waatarn 
haailock, fir. and red aldar 

%x 

Waahlngton 

county. 

MUaouri 

Central Hardwood 

37*57' 

95»59' 

1 

Hark Twain 
National Foraat 

310 to 430 

700 to 1400 

Jaki hlokory, plna. ala. 
aah( aapla. and aaatarn rad 
o*d*r 


site, chosen as representative of 
the northern hardwood association, 
is composed primarily of beech, 
birch, maple, oak, and hickory. The 
current forest is a second growth. 
The original forest was first 
altered and finally devastated by 
clearcutting and fire. The region 
is typified by cool, humid summers, 
moderate rainfall (110 centimeters 
or 42 inches per year), cold, wet 
winters, and significant snowfall 
(140 centimeters or 54 inches). 
Warren County is about 460 meters 
(1500 feet) in elevation, with mod- 
erate relief. It has generally 
well-drained soils. 


3.2.3 St. Louis County, ^4innesota 
(Site III) 

A southern extension of the 
northern or boreal forest in St. 
Louis County, Minnesota, is the 
third site. It has short, hot sum- 
mers and long, extremely cold 
winters. Although precipitation is 
relatively low (64 centimeters or 25 
inches per year) , poor drainage 
resulting from the flat topography 
creates a preponderance of lakes. 
Although the numerically dominant 
species are aspen and birch, the 
forest succession if left undis- 
turbed would favor a climax of 
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spruce and fir. There are scatter- 
ings of pine, especially on the 
drier, sandy soils. 

3.2.4 Sandoval County, New Mexico 
(Site IV) 

Sandoval county. New Mexico, rep- 
resents the most xeric site of the 
TBS project. Annual rainfall ranges 
from 20 to 41 centimeters (8 to 16 
inches), increasing with altitude; 
the summers are dry and hot and the 
winters dry and cold. The site has 
much topographic relief, and the 
vegetation is stratified according 
to altitude. The lowest parts of 
the test site are treeless, but the 
site is generally typified by the 
pinyon and juniper association at 
lower elevations and the pine and 
Douglas fir association at higher 
elevations. 

3.2.5 Kershaw County, South Carolina 
(Site V) 

Kershaw County, South Carolina, 
has the distinction of represent- 
ing two ecosystems. The Piedmont 
Plateau region at the foot of the 
Appalachian Mountains supports an 
oak-pine community which is strati- 
fied by the hilly topography. This 
region has hot and humid summers, 
cool and humid winters, and moderate 
rainfall in summer and winter, with 
lesser amounts in spring and fall. 
On the adjacent coastal plain, the 
lucrative southeastern pine forest 
(loblolly and shortleaf) grows 
abundantly. This portion of the 
site is warmer and wetter than the 
Piedmont but otherwise rather sim- 
ilar climato logically. 

3.2.6 Fort Yukon, Alaska (Site VI) 

The Fort Yukon, Alaska, site con- 
stitutes the northernmost TES site. 
It exemplifies the subarctic coni- 
ferous forest that begins where the 


tundra ends. This forest is domi- 
nated by black and white spruce, 
with lesser amounts of birch, pop- 
lar, and aspen. 

The study site is a transition 
area between two provinces. The 
larger portion is the Porcupine Pla- 
teau and the small portion consists 
of broad river bottoms resembling 
the adjoining Yukon Flats. The site 
is generally flat with permafrost 
creating marshy conditions. Summers 
are short and warm, winters very 
cold, and rainfall limited. Wild- 
fires in the uplands and a changing 
riverbed in the lowlands have played 
major roles in the distribution of 
species. 

3.2.7 Weld County, Colorado (Site VII) 

The only nonforested TES site is 
located in Weld County, Colorado. 
It was chosen as a typical high 
plains grassland association. Domi- 
nated by three species (blue grama, 
buffalo grass, and saltgrass) with 
scattered shrub sages and no trees, 
the weld County site is located on 
rolling hills at the foot of the 
Rocky Mountains. Relief is minimal, 
but the soil is very sandy; drought 
dominates the community. Summers 
are hot and dry; winters are cold 
and dry. Normal rainfall is about 
41 centimeters (16 inches) per year. 


3.2.8 Grays Harbor County, Washington 
(Site VIII) 

The site in Grays Harbor County, 
Washington, is topographically var- 
ied with steep mountains and spec- 
tacular panoreunas. It is the 
wettest, most luxuriant TES site. 
Summers with mild temperatures and 
moderate rainfall and winters of 
moderate temperature and heavy rain- 
fall combine to produce the abundant 
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Pacific Coast conifer forest* This 
forest Is dominated by western hem* 
lock, Douglas fir, and Sitka spruce 
with lesser amounts of western red 
cedar and pine, all of which con- 
tribute substantial amounts of 
timber to the American economy. The 
problems associated with the commer- 
cial aspect make this one of the 
most important of the TES analysis 
areas. 

3.2.9 Washington County, Missouri 
(Site IX) 

The final ecosystem is located in 
Washington County, Missouri, in the 


northern reaches of the Ozark Moun- 
tains. The region is topogra.'^hi- 
cally varied, central hardwoods are 
the major element and improved 
grassland is a minor one. Summers 
are typically hot and humid; winters 
are cold and humid. Rainfall is 
moderate, about 100 to 110 centi- 
meters (40 to 45 inches) per year. 
The forest is composed of oak, hick- 
ory, pine, and some maple and east- 
ern red cedar, all mixed in various 
proportions. 


4. ANALYSIS PROCEDURES 


4.1 SEQUENCE OF ACTIVITIES 

Data processing in the Ten- 

Ecosystem Study consisted of the 

following steps; 

1. Preliminary image analysis - to 
decide which two Landsat images 
would be most useful for analysis 

2. Field survey - to collect ground 
data on about 70 points in the 
study site 

3. Registration - to register the 
two chosen images to each other 
and to a topographic map 

4. Type separability study - to 
develop and test signatures for 
training fields in 90 percent of 
the study area, using all avail- 
able information, and to deter- 
mine which data set would be most 
useful in the simulated inventory 
study 

5. Simulated inventory study - to 
develop and test signatures from 


training fields in the remaining 
10 percent of the study area, 
using only aerial photographs 
as ground truth, and to make an 
inventory of forest types in the 
whole study area using these 
signatures 

6. Map production - to produce an 
alphanumeric classification map, 
using a printer/plotter, ^ and to 
provide the tapes needed by a 
subcontractor^ to prepare a 
color-coded classification map 

4.2 EXPLANATION OF PROCEDURES 

4.2.1 Preliminary Image Analysis 

Up to eight frames of Landsat 

imagery were ordered for each site. 

Data quality and absence of cloud 


^The Gould Printer/Plotter, Model 
5000. 

C 

Seiscom Delta. 
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cover were considered in this selec- 
tion • The frames were chosen to 
represent the entire year or, fail- 
ing in that, to represent tue 
spring or summer from year to year. 

These l/andsat color composite 
images (Isl 000 000 scale) were vis- 
ually compared with the associated 
aerial color-infrared photographs 
(1:120 000 scale) to determine which 
two Landsat acquisitions together 
provided the most forest informa- 
tion. 

Two interpreters were used to 
make this determination. Interpre- 
ter A interpreted the aerial photo- 
graphs covering the site, using 
stereopairs and a scanning stereo- 
scope. His interpretation of the 


first quadrant, along with the unin- 
terpreted Landsat images was given 
bo Interpreter B to ^ used as an 
interpretation key. Using this key. 
Interpreter B then interpreted the 
fourth quadrant of the Landsat 
image. Finally, 100 sample points 
on thio interpreted image were com- 
pared with the corresponding points 
on the interpreted aerial photograph 
and i, percentage of correlation 
between the two interpretations was 
calculated. 

Of the images from Landsat passes 
over the same site, the one with the 
highest correlation was chosen for 
use. The date with the second 
highest correlation and with suffi- 
cient temporal separation was also 
chosen. 




% 


TABLE II.— percentage OF CORRELATION OF EIGHT INTERPRETED 
LANDSAT IMAGES WITH AERIAL PHOTOGRAPHS* 

SITE IX (WASHINGTON COONTF, MISSOURI) 


Acquisition 

date 

Image 

identification 

Correlation, 

percent 

Remarks 

May 24, 1973 

1305-16121 

76.03 


August 4, 1973 

1377-16111 

— 

Cloud cover 

July 30, 1974 

1737-16025 

80.16 


September 22, 1974 

1791-16004 

76.03 


October 10, 1974 

1809-16002 

80.99 


November 15, 1974 

1845-15591 

82.64 


March 3, 1975 

1953-15544 

78.51 


May 14, 1975 

5025-15511 

— 

Cloud cover 


♦Aerial photography acquired in November 1974. 
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site IX provides a good example 
of the results of the process 
of preliminary image analysis 
( table II ) . The Landsat image best 
correlated with the aerial j>hoto- 
graphs was that acquired Novem- 
ber 15, 1974. The image with the 

next best correlation was that 
acquired October 10, 1974; but, 

since these dates were quite close 
and since the July 30, 1974, acqui- 
sition had almost the same correla- 
tion and provided the desired tempo- 
ral separation r it was chosen as the 
second image to be used. 

4.2.2 Field Survey 

The interpreted Landsat imagery 
was also used in the selection of 
checkpoints to be visited during the 
field survey. It was thought that 
about 70 points could be checked 
during tlie 1-week trip. These 
points were allocated according to 
the apparent class proportions in 
the imagery of the site. The loca- 
tions of these samples were chosen 
on the basis of accessibility. 

An important restriction on the 
collection of such ground data was 
that a representative area approxi- 
mately 10 percent of the site was 
not to be field checked. During the 
simulated inventory study, ground 
truth for this area would be inter- 
preted from the aerial photographs. 
This procedure simulates future 
large-scale inventory operations 
where ground truth by field trip may 
nob be feasible. 

Figure 2 is an example of the 
checklists completed at all field 
points. The locations of these 
checkpoints could be changed as 
field conditions dictated and as 
Forest Service personnel advised. 
In fact, an important objective in 
making this field trip was to coor- 


dinate with Forest service personnel 
and gather ancillary data from them. 

4.2.3 Registration 

The registration process consis- 
ted of three operations. First, the 
two selected Landsat images were 
registered to each other. Then, the 
Landsat imagery was registered to a 
topographic map. And finally, the 
boundary of the county and that of 
the national forest or grasslands 
were delineated on the imagery. 

Image-to-lmage registration was 
performed on the Earth Resources 
Interactive Processing system 
(ERIPS). Using channel 2 from each 
image, ^ the second- ranked image was 
registered to the first. If the 
difference between the mean radiance 
values of the two images was greater 
than an experimentally determined 
value, this radiance difference was 
subtracted from the image with the 
higher value to make the two more 
comparable. The operator picked 
about 60 control points of high con- 
trast on the first image, and the 
Sequential Similarity Detection 
Algorithm (SSDA) then located these 
points on the second image. The 
operator could delete bad points and 
enter new ones until the results, as 
judged by an error vector display, 
were satisfactory. This operation 
determined the matching polynomial, 
which was then applied to all fov^r 
channels of the second image. 

The root me^m square (rms) error 
of the image- to- image registration 


^Channel 2 represents bandwidth 
0.6-0. 7 Jim. The bandwidths repre- 
sented by the other channels are 
channel 1: 0.5-0. 6 jjm; channel 3; 

0. 7-0.8 Jim; and channel 4; 0.£i- 

1.1 Jim. 
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Figure 2.— Sample checklist completed in the field. 
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ranged from 2,4 picture elements 
(pixels) for site ll to O.S pixel 
for Sites VIII and IX. 

Image- to- ground registration was 
accomplished by registering the 
first image to a 1:250 000-scale 
topographic map. First, control 
points were located on the image, 
which was displayed on the image 
100.' Then, the corresponding 
points were located on the topo map 
and their coordinates were digi- 
tized.® The two sets of control 
point coordinates underwent a least- 
squares analysis to determine the 
coefficients of the matching polyno- 
mial. These coefficients were then 
input to the registration-rotation 
program to produce a rotation fac- 
tor, which was used to remove the 
effect on the handsat image of the 
Earth’ s rotation during the acquisi- 
tion. Another type of corre^hion 
was required to complete the image- 
to- ground registration. A Landsat 
pixel represents an area that is 
longer in the north- south direction 
than in its east-west dimension, but 
on the Image 100‘s cathode- ray tube 
it is displayed in a square array. 
Thus, the image as displayed is 
foreshortened. To approximate the 
true representation, about every 
third line of data was replicated. 

Image- to- ground registration was 
poorest for Site IV, with a sample 
rms error of 1.63 pixels and a line 
rras error of 1.80 pixels, and best 
for Site IX, which had a sample rms 
error of 0.104 pixel and a line rms 
error of 0.757 pixel. 


^General Electric Interactive 
Multispectral Image Analysis System, 
Model 100. 

®Using the Dell Foster x-y digi- 
tizer. 


Administrative boundaries were 
delineated on the registered lAndsat 
images by determining points along 
these boundaries on the topograpliic 
map, using the Dell Foster digi- 
tizer, and then approximating the 
boundary on the image with a series 
of straight lines between the chosen 
points, using the Irregular cursor 
Program. The results were then 
stored on the magnetic tape as a 
separate file. 

4.2.4 Type Separability Study 

Because the Image 100 screen can 
display a maximum of 512 pixels by 
487 lines, the approximtely 1000- by 
1000-pixel image area containing the 
study site was divided into quad- 
rants, each 4S5 by 485 pixels. 
False-color transparencies were made 
of these quadrants using the produc- 
tion film converter and assigning 
blue to channel 1, green to channel 
2, and red to channel 4. 

On these transparencies, the ana- 
lysts delineated training fields^ 
representing the various forest 
types and other classes of interest. 
These training fields were chosen 
from those verified by field survey 
and thus should have been, like the 
checkpoints, proportional in number 
to the extent of the various vegeta- 
tive classes in the site. As neces- 
sary, such ground- verified training 
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It should be emphasized that 
these fields were not ordinary crop 
fields, where relatively pure, 
field-center pixels and mixed, 
boundary pixels could be distin- 
guished. Forest areas are generally 
mixed; therefore, it becomes neces- 
sary for the analyst artificially to 
delineate training fields in an 
attempt to represent a particular 
type of growth. 
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fields were supplemented by training 
fields verified by photointerpreta- 
tion, cousidered almost equally 
reliable. 

The locations of these training 
fields were entered on three data 
sets one set for each of the two 
selected Landsat acquisitions and a 
temporal data set composed of chan- 
nels 2 and 4 from each of those 
dates* 

A signature was then acquired for 
each class in each quadrant of each 
data set* Signature acquisition 
consisted of recording the four rad- 
iance values . jr each pixel in the 
training fields designated as 
belonging to that class and then 
computing the mean vector and 
covariance matrix for that class* 
These parameters constitute the 
signature* The quadrant signatures 
for the class were then combined 
into a master signature for that 
image. 

The master signatures for each 
data set were tested by using them 
to classify the training field 
pixels in that data set — the same 
pixels that had been used to compute 
these master signatures. The ac- 
curacy of this classification was 
determined by dividing the number of 
pixels classified into a particular 
class by the number of pixels in the 
training fields for that class. Any 
deviation from 100 pi*rcent indicates 
some overlap between classes. A 
high percentage (above 80 or 90 per- 
cent in this study) indicates that 
the training fields were consist- 
ently chosen by the analyst and that 
it is possible for this technology 
to distinguish between the classes. 

In the first test of separabil- 
ity, forest, nonforest, and water 
were divided into Level II 


classea — softwood, hardwood, grass- 
land, and water* If thoisa catego- 
ries proved to be separable, then a 
second test was condur<tted to deter- 
mine the separability of the more 
specific Level III typeai e.g*, fir, 
pine, or cedari oak, maple,, or 
aspen; improved or unimproved* 

The acquisition date that pro- 
duced the highest separability fig- 
ures was taken to indicate the best 
season for acquiring data from the 
site* This data set was also chosen 
for use in the simulated Inventory 
study. 

4.2.5 Simulated Inventory Study 

The simulated inventory study 
used the data set found best for 
separability purposes and produced 
an inventory at the level of detail 
indicated by the results of the 
foregoing study (in every case, 
Level II). signature acquisition 
and testing resembled the procedures 
used in the separability study 
except that in this case training 
fields were Chosen from the reserved 
10 -percent area and verified only by 
photointerpretation* These signa- 
tures were then extended to 
the whole study site and used to 
classify it into the Level II 
catego)ries. 

4.2.6 Map Production 

Before maps were made of the sim- 
ulated inventory results, the clas- 
sification tapes went through two 
processes. The quadrants were care- 
fully joined to form an image of the 
entire site. The quadrant classifi- 
cation images were also smoothed 
using the GETMIX/CLEAN program 
(ref* 7). This program eliminates 
feature areas smaller than 0*04 
square kilometer (10 acres) by 
assigning these areas the classifi^ 
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ORIGINAL' PAOC 

black and white photograph 



Tho final mapping product for 
each TBS aita waa a color* coded 
claasif ication oMp produced from the 
aimulated inventory reaulta. 
Theae mapa were produced by a aub* 
contractor.^ By a *‘^^t image 
proceaa* tho claaaif icw^.. “lata are 
tranaferred from computer tape to 
light*aenaitive film platea by meana 
of a laaer beam. The imar,e ia then 
printed uaing a v tree-color 
lithographic overlay proceaa. The 
claaaif ication map for Site V, 
Kerahaw County. South Carolina, ia 
given here aa an example (fig. 4). 
The claaaif ication mapa for all the 
other aitea except Sitea XV and IX 
are preaented in appendix A (the map 
for Site IV can ^ found in sec- 
tion 5.2 and that for Site IX in 
section 7.1.9). 

An interim mapping product, 
needed for evaluation, was an alpha- 
numeric classification map produced 
on the printer/plotter. (See sec- 
tion 6.2. figure 6b. for an example 
of the appearance of such a aiap. ) 


^^Por this product, the classifi- 
cation tapes for the quadrants were 
joined, but the GETNIX/CLEAN program 
was not applied. 

^^Seiscom Delta. Inc. 

Digital Images Division 
P.O. Box 36928 
Houston. TX 77036 


cation of their surroundings. Areas 
this small are generally not of 
intereac in timber and rancje manage- 
ment planning, and the removal of 
the salt-and-pepper effect nakes the 
classified image more comprehensi- 
ble. Figure 3 shown the effect of 
3BTMIX/CLEAN on one quadrant of the 
Warren County. Pennsylvania, site. 


Figure 3.— Classification of quad- 
rant 2 of Site II (Warren County, 
Pennsylvania) before and after 
applying GETMIX/CLEAN. Dark 
gray • hardwood; light gray - 
water; white - other. 
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5. RESULTS 


5.1 TYPE SEPARABILITY STUDY 

Th« results of the type sepere-* 
blLlty study were determinations of 
the separability of signatures for 
forest and grassland classes. These 
determinations were made by an accu- 
racy assessment technique and, as 
such, will be discussed in sec 
tion 6.1* Conclusions drawn from 
the results of the type separability 
study v>ill be presented here# 

Tiie results indicate that separa- 
tion is attainable at Level II 
(e.g., softwood from hardwood) but 
generally not at Level III (e.g*, 
pine from spruce, maple from oak) . 
One case where Level III details did 
seem separable, as judged by the 
classification of the training field 
pixels, was Grays Harbor County, 
Washington* In the abundant soft- 
wood forest of this site, three age 
categories seemed to be distinguish- 
able — softwood 1 (old growth) , 
softwood 2 (pole stage to sawtimber 
stage) , and softwood 3 (very young, 
regenerated softwood). (Training 
field classification accuracies were 
90, 85, and 72 percent, respec- 
tively.) The old growth was con- 
centraced in the Olympic National 
Forest; and the young, regenerated 
trees were concentrated in the pri- 
vately owned lands. 

Another conclusion that was drawn 
from the results of the type separa- 
bility study was what portion of the 
year generally provided the best 
Landsat data to be: used to make for- 
est and grassland inventories. The 
single- date or temporal data set 
that produced the highest training 
field classification accuracies was 
tdken as Indicating the best season 
for separability purposes. The best 


date for each site is given in 
table III. The reader should recall 
that the three acquisitions tested 
in the separability study were win- 
nowed out of up to eight acquisi- 
tions that underwent preliminary 
image analysis. Thus, the best sea- 
son conclusion indicates not only 
when the classes may be most separ- 
able but also when there is the 
least Interference by cloud or snow 
cover . 

6.2 SIMULATED INVENTORY STUDY 

The results of the simulated in- 
ventory study were calculated as 
proportions; that is, the number of 
pixels classified into a certain 
category was divided by the total 
number of pixels in the study site. 
These estimates are of little 
significance unless they are com- 
pared to some standard of the true 
proportions, as will be done in the 
section on accuracy assessment. 
However, as an example, the esti- 
mated proportions for Site III, St. 
Louis County, Minnesota, are given 
here (table IV)?! Appendix B pre- 
s« ts the proportion estimates 
for the other sites for factual 
reference. 

The reader may notice that the 
unclassified portion of the inven- 
tory results is rather high, 37 per- 
cent in this case. The Inventories 
for the other sites also showed this 
tendency. In Sandoval County, New 
Mexico, Site IV, the chosen sig- 
natures proved to be 100-percent 


Figure 4.— Clasaificmtion mp for 
Site V, Kei'ahav County, South 
Carolina, 
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TABLE III.~ ACQUISITION OATE OF LANDSAT IMAGERY FOUND BEST 
FOR SEPARABILITY PURPOSES 


Site 

number 

site 

location 

Ecosystem 

represented 

Best 

date 

I 

Grand County, 
Colorado 

Rocky Mountain Conifer 

August 1973 

II 

Warren County, 
Pennsylvania 

Northern Hardwood 

May 1975 

III 

St. Louis County, 
Minnesota 

Northern Conifer 

July 1973 

IV 

Sandoval County, 
New Mexico 

Pi nyon- Jun ipe r 

August 1975 

V 

Kershaw County, 
South Carolina 

Oak-Pine and 
Southeastern Pine 

Temporal (May 1973 
and February 1976) 

VI 

Fort Yukon, Alaska 

Boreal 

Temporal (September 
1973 and August 1976) 

VII 

Weld County, 
Colorado 

Grassland 

July 1974 

VIII 

Grays Harbor 

County, 

Washington 

Pacific Coast 

September 1974 

IX 

Washington County, 
Missouri 

Central Hardwood 

July 1974 


separable; however, 85 percent of 
the site remained unclassified. TES 
personnel responded to this situ- 
ation by reanalyzing Site IV to 
determine whether the unclassified 
portion could be categorized. Data 
from the first study were reanalyzed 
using an unsupervised clustering 
algorithm. The results were cate- 
gorized in an ecologically signifi- 
cant way using the National Site 
Classification System (NSCS). 


The NSCS, developed by Driscoll, 
Russell, and Meier (ref. 8), struc- 
tures information on landform, soil, 
vegetation, and aquatic regime to 
derive ecological land units and 
ecological water units. These units 
can be combined as needed. This 
classification system thus seems to 
offer both continuity and fl<'!xibil- 
ity to forestry researchers. In 
this case, the NSCS allowed TES 
Investigators to rank the spectral 



TABLE IV.- PROPORTION ESTIMATES FOR 
SITE III, ST. LOUIS COUNTY, MINNESOTA 


(Inventory based on Landaat image 
acquired in July 1973] 


Class 

Proportion estimate 

Softwood 

0.195 

Hardwood 

.302 

Grassland 

.059 

Hater 

.075 

other 

.369 


classes of the site into a natural 
hierarchy. As there was no regis- 
tration done for this reanalysis, 
the accuracy of the unsupervised 
classification was checked by field 
observation. 

The resultant classes and the 
percentages of the site they repre- 
sent are given in table V. If these 
communities are translated into the 
original TES categories, the ''other” 
category is reduced to 12 percent, 
which represents the two categories 
of bare rock described. Table VI 
compares the original inventory and 
the reanalysis. The classification 
map for this site shows very clearly 
the topographic statif ication of the 
NSCS communities (fig. 5). 

5.3 COSTS 

Because those interested in con- 
ducting similar research and those 
who plan to apply the developed pro- 
cedures operationally will naturally 
want to estimate the cost/benefit 
ratio, the costs of the Ten- 
Ecosystem Study are presented here 
as further ''results." 

In order to provide necessary 
information to both the research 


TABLE V.- classes DEVELOPED BY 
REANALYSIS OP SITE IV, 


SANDOVAL COUNTY, NEW MEXICO 

[Based on an unsupervised clustering 
and categorized using the NSCS] 


CoBBSunlty 

Percentage 
of site 

Ponderosa pine and 
Douglas fir 

17.6 

Montane river gallery 

3.9 

Plnyon pine 

6.3 

Plnyon pine and juniper 

12.2 

Grassland and juniper 

9.2 

Desert grassland 

19.3 

Desert shrub 

16.1 

Lowland riverine gallery 

1.3 

Dark bare rock 

11.0 

Light bare rock 

1.0 


TABLE VI.- COMPARISON OF ORIGINIU:. 
INVENTORY PROPORTIONS AND 
RE ANALYSIS RESULTS FOR SITE IV, 
SANDOVAL COUNTY, NEW MEXICO 


Class 

Inventory 

Reanalysls 

Softwood 

0.087 

0.402 

Hardwood 

.004 

.0S3 

Grassland 

.061 

.445 

Water 

.000 

Not applicable 

Other 

.648 

0.120 


Figure 5.— Classification map for 
Site IV, Sandoval County, New 
Mexico. 
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manager and the potential user, TES 
costa are presented in two formats. 
Actual research costs are described 
as incurred for significant work- 
breakdown units, Tnis allows for an 
analysis of the projected costs for 
research having similar technical 
objectives. Costs that have been 
subjectively adjusted to an appli- 
cations environment are also 
described. The purpose of the latter 
is to provide a perspective on the 
situation where the resulting prod- 
uct is the primary concern and where 
validation processes are used as 
necessary for quality assurance. 

In appendix C are several summary 
cost tables that support this dis- 
cussion of project costs. 

5.3.1 Direct Costs for Research 

Research direct costs are accumu- 
lated in terms of labor hours, mate- 
rials, travel, and computer access. 
The mean direct cost per site is 
about $60 100. 

An analysis of the average costs 
by function suggests am important 
consideration for a research manager 
concerned with estimating and con- 
trolling costs. Computer access time 
must be managed with high efficiency 
since it may well be the most sig- 
nificant single cost of the project. 
For TES, approximately 65 percent 
of the research direct costs are 
related to computer access charges. 

The cost per unit area is calcu- 
lated by dividing the total cost by 
the area analyzed. The mean cost is 
about 20 cents per square hectometer 
(8 cents per acre), and the range is 
from 12 to 27 cents per square 
hectometer (5 to 11 cents per acre). 


6.3.2 Direct Coiti for Applications 

An analysis of TBS costs in a 
mannet meaningful to application 
users requires a restructuring of 
the actual incurred costs to include 
only those functions that are appro- 
priate to an operational setting. 
By weighting the actual research 
costs for these functions, it is 
possible to estimate applications 
direct costs. 

The estimated average cost per 
site is about $34 100. The mean 
costs per function show that an 
application using TES procedures 
would have computer costs which, 
although reduced from the research 
total, remain the major item. 

Applications direct costs show a 
significant reduction in the cost 
per unit area. The mean cost of 11 
cents per square hectometer (5 
cents per acre) for applications is 
little more than half that for 
research. 

5.3.3 Comparison of Costs With 
Site Features 

Variations in costs may often be 
correlated with some feature of the 
work process or with some aspect of 
the materials being processed. If a 
strong correlation can be estab- 
lished, it is possible to predict 
the effect of the variables. This, 
in turn, can be an effective manage- 
ment tool for planning and control- 
ling future costs. Correlations 
established by linear regression are 
shown in appendix C. 

There is a strong correlation 
between analyst data processing 
experience and the cost to process a 
site. Comparing the average costs 
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for the analysts having the most ADP 
experience with the average costs 
for analysts having the least exper- 
ience suggests that a cost savings 
can be realized using personnel 
experienced with ADP. 

There is a very weak correlation 
between site class proportions and 
the cost to process the site. This 
weak correlation suggests that the 
site ecosysten is not a significant 
force in determining the cost of 
processing. 


5.3.4 Total Project Costs 

Direct costs for research and 
applications are only a portion of 
the actual total project costs. 
Indirect costs > such as manufactur- 
ing overhead, engineering overhead, 
general and administrative expenses, 
and profit, often account for more 
of the final expense than do the 
directly incurred costs. 

Project costs can be divided into 
components, and a model can be con- 
structed which defines the relation- 
ship between the components. For 
TES, the direct costs are known, and 
a model can demonstrate how indirect 
costs are determined on the basis of 
the direct costs. A sample model 
for determining total project costs 
for a fixed-price contract is pre- 


6. ACCURACY 


6.1 TYPE SEPARABILITY STUDY 

The purpose of the type separa- 
bility study was to determine at 
what level of detail forest and 
grassland features could be distin- 
guished on the basis of their multi- 
spectral scanner response. Training 


sented in appendix C. Although it 
is possible to construct several 
other types of models which may have 
equal validity for specific situa- 
tions, this particular version will 
serve to demonstrate the total proj- 
ect costs for TES. The rates and 
computational methods illustrated do 
nob necessarily reflect those used 
by any one agency or company in par- 
ticular but are drawn from a num- 
ber of qualified sources (refs. 9 
and 10 ) . 

Solving the model, the mean total 
of direct and indirect costs is 
$90 627 per site for the research 
costs of TES and $53 191 for the 
estimated application costs. Total 
costs per unit are 29.8 cents per 
square hectometer (12.0 cents per 
acre) for research and 17.5 cents 
per square hectometer (7.1 cents per 
acre) for estimated applications. 

An additional reduction, of these 
costs possibly could be realized 
through the implementation of effi- 
cient processing techniques designed 
to meet a single set of specific 
requirements. For ex^unple, the con- 
tract for a recent project 
(ref. 11), which employs computer- 
assisted analysis of Landsat data to 
identify 18 forest vegetational 
classes, was awarded at a total cost 
of about 7.7 cents per square hecto- 
meter (3.1 cents per acre). 


ASSESSMENT 


field signatures were acquired for 
classes at one level of detail, and 
the separability of these classes 
was determined by the accuracy of 
the classification of the pixels 
from these seune training fields. A 
percentage less than 100 indicates, 
an overlap between classes. This 


kind o£ accuracy asoeasment thus 
testa how well this sensor detected 
spectral differences between the 
designated classes and how consis- 
tently the analyst chose training 
fields characteristic of the 
classes • The applicability of such 
signatures remained to be tested in 
the simulated inventory study. 

All the site studies achieved 
high training field classification 
accuracies at Level II, but the 
accuracy figures for Level III 
classes fell below the requirements. 
As an example, the accuracy assess- 
ment of the type separability study 
at Site VI, Port Yukon, Alaska, is 
presented here (tables VII and 
VIII). If readers are interested in 
the exact figures for the otVier 
sites, they are referred to the 
individual final reports. 

TABLE VII.- TRAINING FIELD CLASSI- 
FICATION ACCURACIES FOR THE LEVEL II 
SEPARABILITY STUDY AT SITE VI 
(FORT YUKON, ALASKA) 


Class 

September, 

percent 

August, 

percent 

TBD|>ora 1, 
percent 

Softwood 

99.0 

99.5 

99.9 

Hardwood 

98.0 

95.0 

99.0 

IVndra 

97.0 

97.0 

99.0 

Water 

99.5 

99.0 

99.9 

Overall 

accuracy* 

98.4 

97.6 

99.5 


*Determined by sunming all correctly claeaifled 
pixels and dividing by the total number of pixels. 

6.2 SIMULATED INVENTORY STUDY 

A similar test was made of the 
signatures developed for the simu- 
lated inventory study; and, again, 
high training field classification 
accuracies were achieved. However, 


because the purpose of the simulated 
inventory study was to determine how 
successfully signatures acquired 
from only 10 percent of the area and 
developed using only photointerpre- 
tation could be extended to classify 
the entire study area, an assessment 
of the resulting inventory was 
judged to be more important than the 
accuracy of the signatures alone. 

The accuracy of the classifica- 
tion map was assessed by sampling 
the map and comparing the classifi- 
cation of these samples with the 
interpretation of the corresponding 
samples on the aerial photographs of 
the site. The percentage of correct 
classification (PCC) was estimated, 

as was the PCC confidence interval 

1 2 

at the 90-percent level. 

TAiJLE VIII.- TRAINING FIELD CLASSI- 
PICA^i'MON ACCURACIES FOR THE LEVEL III 
SEPARABILITY STUDY AT SITE VI 
(FORT YUKON, ALASKA) 


Class 

Tenporal, percent 

Sparse spruce 

92 

Dense spruce 

66 

Grass tundra 

99.5 

Brush tundra 

44 


1 2 

'The simulated inventory proce- 
dures were not amenable to display 
of pixel-by-pixel classification 
accuracy in a confusion table or 
matrix that indicates ex’rors of 
omission and commission; i.e., how 
many pixels were classified as B, C, 
and D when they should have been 
classified as A (omission) and how 
many pixels that should have been 
classified as B, C, or D were clas- 
sified as A (commission). 
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A stratified sampling strategy 
was used (see fig. 6a and b). In 
some forestry applications/ where 
any one area is likely to be mixed/ 
stratified sampling is more 


efficient than random sampling. In 
contrast/ random sampling may be 
preferred in an agricultural 
situation, where an individual field 
is fairly pure.^^ 



Figure 6.— Two-stage sampling strategy. 


^^By analogy/ consider a survey 
to determine the racial makeup of a 
city. If the population is well 
integrated, a limited number of sam- 
ples can achieve best results if 
they are grouped to determine the 
makeup of small areas, which are 


then av67^aged to estimate the city- 
wide proportions. Conversely, if 
the population is segregated, its 
makeup can more accurately be esti- 
mated by distributing the same num- 
ber of samples at random throughout 
the city. 
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(b) ClABBltiCdtibn map o£ psu |7, quadrant 2/ Sito VlII 
(Cray® Harbor County# Wa»hlngtgn) showing tha random 
location of tha secondary sampling units (93U*s). 

□ - SSU 


Figure 6.— Concluded. 


To evaluate the accuracy of the 
TES inventory map, the coordinates 
of 10 to 25 primary sampling units 
(PSU Vs) were randomly generated. If 
any of these were found to be cloud 
covered on either the aerial photo- 
graphs or the Landsat image, they 
were replaced by the same method. 

The aerial photographs were reg- 
istered with the alphanumeric print- 
out and the 50- by 50-pixel PSU's 
located on each. Then, again using 
a random- number generator, 10 sec- 
ondary sampling units (SSU's), each 
2 pixels by 2 pixels, were selected 
within each PSU on the classifica- 
tion map. 


As each PSU on the photograph was 
alined with the corresponding PSU on 

the alphanumeric printout,^'* an ad 
hoc evaluation procedure, developed 
by Kan (ref. 12), was carried out. 

First, the area on the photograph 
covered by the SSU was interpreted 
in 10-percent increments ( see 
fig. 7a) • The classification of the 
SSU on the printout was recorded 
(see fig. 7b). Since the SSU was a 
4-pixal area, this classification 
was necessarily in 25-peroent incre- 
ments. Then the eight surrounding 
possible locations, each offset from 
the original SSU location by 1 
pixel, were chec)ced to see if their 
classifications more closely matched 
the photointerpretation for the SSU 
(see fig. 7c). 

This benefit of the doubt was 
given in the project evaluation in 
order to compensate for a possible 
misregistration of up to 1 pixel and 
also to compensate for the built-in 
difference between the 10-percent 
interpretations of the photograph 
and the 25-percent classifications 
c£ the map. 

If the computed difference 
between the photointerpretation and 
the classification for the SSU was 
less than a given threshold, then 
the SSU was scored as correctly 
classified. since there were ' 10 
SSU's per PSU, the number of SSU's 
scored as right was easily converted 
to the percentage of correct classi- 
fication for the PSU (see table IX). 
These were then averaged to provide 
the PCC for the site. The PCC was 
taken to be an indicator of the 
overall accuracy of the classifica- 
tion map. Statistical formulations 


^^Using the Bausch & Lomb 2toom 
Transfer Scope. 
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Figure 7.— TES evaluation procedure. 


(shovm in table IX) were applied to 
determine the confidence interval 
for the PCC at the 90-percent confi- 
dence level. This means that if 
this evaluation were repeated 100 
times, the true PCC could be expec- 
ted to be contained within the con- 


TABLE IX. - SUMMARY OF PCC 
CALCULATIONS FOR SITE IX, 
WASHINGTON COUNTY, MISSOURI 
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fidence interval in 90 casesa In 
practice, if the confidence interval 
exceeded about 7 percent of the PCC, 
then more PSU's, up to 25, were 
evaluated. The PCC results are 
given in table X. 

In addition to malting this PCC 
determination, the same averaging 
scheme was used to determine class 
proportions from the inventory sam- 
ples and the photo samples. Assum- 
ing the photosampled proportions to 
be correct, proportion errors and 
related measures were isalculated. 
These are presented in appendix D, 
with the results for Site IX, Wash- 
ington County, Missouri, shown here 
for explanation ( table XI ) . If the 
confidence interval around the error 
contains 0, the estimate may be cor- 
rect, or at least any bias that 
exists cannot be said to be signifi- 
cant. A tight confidence interval 
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TABLE X,- PERCENTAGE OP CORRECT 
CLASSIFICATION WITH CONFIDENCE 
INTERVAL 


Sit* 

PCC 

Half the 
confidanc* 
interval at 
the 90-paroant 
l*val, 

Number of 
PSU'a used* 

z 

75.0 

5.4 

20 

IX 

a«.6 

5.8 

16 

zzz 

76.0 

5.1 

20 

IV 

93.5 

3.9 

20 

V 

70.0 

5.7 

24 

VI 

72.4 

5.9 

25 

VII 

73.0 

4.7 

10 

VIII 

7J.!,6 

6.7 

25 

IX 

85.0 

6.2 

IQ 


*The number of PSU*a la choaen ao that tf. q la 
on the order of 5 percent. 


indicates precision (consistency) in 
making such estimates. The size of 
the error with respect to the object 
of the estimate is indicated by the 
relative error. 

In this example, neither the 
softwood nor the grassland propor- 
tion estimate can be said to be sig- 
nificantly biased since both their 
confidence intervals contain 0. The 
hardwood proportion estimate from 
the inventory sample, however, 
appears to be a significant under- 
estimate of the photosampled propor- 
tion. But, because of the abundance 
of hardwood in this site, its rela- 
tive error is smaller than that for 
either of the other two classes. 

If such figures are displayed 
graphic*al*ly , as was done in this 
case, they may suggest other infor- 
mation. Figure 8 suggests that the 


TABLE XI. >- SUMMARY OF CLASS PROPORTION 
ERRORS FOR SITE IX, 
WASHINGTON COUNTY, MISSOURI 


Clan* 

Invantory 

alaaa 

proportlenf 

P 

Photograph 

slaai 

proportion, 

P 

hvoraga 

•rror, 

a 

Standard 
davlatlon 
of arror. 

•» 

Softwood 

0.02S 

0.029 

0.004 

0,0099 

Hardwood 

.803 

.075 

.072 

.028 

craaitland 

>0$3 

.061 

.008 

.919 

W*tar* 





Othar 

.120 

.035 

-.085 

.026 


Claai 

Half tha oonfidanoe 
intarval at th« 
90-p«ra«nt laval. 
*0.9 

Confidano* 

interval, 

D t fi 

Paroant 

relativu 

arror, 

rn 

Softwood 

0.10 

(-0.014, 0.022) 

13.79 

Hardwood 

.052 

( .021, .125) 

8.14 

Oraaaland 

.036 

( -.027, .045) 

14.75 

tfatara 




Othar 

.047 

( -.132, .038) 

-242.86 


■Nona In tait area. 


notation 

“ Pt " Pi “ individual error 

Q ■ i D, “ average error 
"l ^ 

- SrIrHf t («>i - • variance 

f m finite jpopulation eonatant ■ where 

m ■ number of fSU’e in aample loheme and 
N « total numbor of PSU'a in entire population 

fig n x l,g33S|. * half the confidence interval at 
the 90-percont confidence level 

na X ^ X loo * « lative error 

class deficiencies may be the result 
of migration toward the catchall 
"other” category. 

The sam)^led inventory proportion 
estimates 'vere regressed against the 
photosamplt>d proportions to produce 
a regres&tfm transformation to be 
applied to the proportion estimates 
from the whole simulated inventory. 
The resulting regression equations 
and the estimates calculated by the 
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Fi^re 8.— Graphic display of class 
proportion estimates for Site IX, 
(Washington county, Missouri ) . 


application of these equations are 
presented in appendix Ef A related 
calculation, that of the coefficient 
of determination or r , can be seen 
as an accuracy indicator. The co^'f- 
ficient of determination is that 
portion of the sum of the squared 
deviations about the mean which is 
resolved by the regression. If r^ 
is 1, then the regression equation 
is able to resolve completely any 
differences between the estimate and 
the standard. If it is 0, then 
there is no linear relationship 
between estimate and standard and a 
regression line is useless. 

in the example given here 
(Site III), the coefficient of 
determination is quite high for 
softwood, hardwood, and water, thus 
indicating a good correlation be- 
tween the sampled inventory propor- 
tion estimates for these classes and 


the corresponding photoaampled pro- 
portions. The r^ for grassland is 
quite low and indicates that the 
inventory estimate for this small 
proportion of the eite is not very 
reliable (see table XXI). 

The preceding methods of assess- 
ing the accuracy of the simulated 
inventory classification are all 
based on internal comparisons. 
Photointerpretation is held as the 
standard of ground truth, and such 
photointerpretation also formed the 
basis of the signatures used to make 
the classification. The Ten- 
Ecosystem study Investigation Plan 
(ref. 13) called for comparison with 
published figures; however, these 
were not generally available. 
Still, the scientists for Sites I, 
II, IV, V, and IX did manage some 
comparisons using figures from the 
Forest Service and Soil Conservation 


TABLE XII REGRESSION ESTIMATES 
OP PROPORTIONS AND ASSOCIATED 
PRECISION FOR SITE III, 

ST. LOUIS COUNTY, MINNESOTA 


Cl... 

siBuUt.ii 

inv.ntory 

prQparcioiif 

1‘lnv 

imgraaiion 

aquation 

Sagraialon 

esUaiata« 

P 

Oo.fftpt.nt of 
..t.rjiln.ttoflf 

Softwood 

0495 

? - l-*o^iPinv 
f o.ous 

o.ai4 

0.924 

Hard^d 

402 

P • 

4 0.0595 

.775 

•929 

Matar 

•075 

? • 

t OfOU7 

.090 

•974 

draaaland 

.059 

P * 

4 o.oaas 

.092 

.145 


Ct.M 

Standard 

afror^ 

s 

Half tha oonfldanoa 
Interval at tha 
90*|>ardant laval 
‘4.»* 

ConflMno. 
Int.rv.l 1 
P * 

Mrcnt 

f.l.flV* 

v.rl.tlon. 

P 

lottuooa 

0.0150 

0*024 

(O.ln, 0.340) 

U44 

Kardwpod 

.415 

• 024 

.1.4) 

t.t 

H.C.r 

• DOS 

.414 

( .47.. .104) 

15.90 

Oraailand 

.0»4„ 

• C31 

) .41»t .Oil) 

17.1* 


** 0 .» ■ 
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service of the USDA. ^'hese compari- 
sons are presQnte<i in appendix 
with that for Site V given hero. 

Using the spectral resolution^® 
determined according to the estab- 
lished procedures/^’ the relative 
differences between the proportions 
estimated by the simulated Inventory 
study and the proportions from the 
1967 Forest Service survey (ref. 14) 
were high. When the spectral 
resolution used for classification 
was reduced/ tlie class proportion 
estimates increased and came closer 
to the Forest Service figures (see 
table XIII). 


^®The reader is cautioned that 
the basis of comparison differs from 
site to site. 

^®The spectral resolution of a 
multispectral scanner (MSS) is a 
function of the number of radiance 
values in which the data can be 
expressed. In the case of the 
Landsat MSS/ a datum is recorded as 
a number from 0 through 127 (0-63 
for channel 4 ) . Spectral resolution 
is not to be confused with spatial 
resolution/ which is a function of 
the smallest ground area that can be 
distinguished. 

1 7 

The spectral resolution of the 
data was to be halved until the var- 
iance of the training field signa*>’ 
ture in any one channel became less 
than 4.5. 


The explanation for thia seeming 
paradox (better classification from 
lower resolution) may lie in match- 
ing the fineness of the resolution 
to the fineness of the classifica- 
tion desired.^® The TES inventory 
attempted to classify an area as 
pure softwood/ for instance/ when in 
reality it was a mixture of soft- 
woods and some hardwoods or even 
grasses. Furthermore, the inventory 
attempted to extend signatures 
developed In one area to classify 
another area where the feature char- 
acteristics might be different. 
This degree of generalization may 
account for the better performance 
using a coarser picture. 

In another attempt to assess the 
accuracy of the simulated inventory 
classification by eompariaon to an 
external standard, the scientists 
for Sites I, VII, and IX improvised 
an evaluation by ground-verified 
test fields. They applied the simu- 
lated inventory signatures to clas- 
sify the pixels of the training 
fields from the type separability 
study. All pixels from any one 
training field were assumed to be of 
the designated type, which was field 
checked. The results are shown in 
table XIV. 


^®By analogy, it might be easier 
to distinguish 4 general features in 
a picture if the specific areas mak- 
ing up these features were colored 
with 8 crayons rather than 64. 
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TABLIS Xm— COMPARISON DiTWEEN INVENTORY CLASS! PI^^iflON PROPORTIONS AND 
FOREST SERVICE AND SOIL CONSERVATION SERVICE (8CS) ACREAGE 
PROPORTIONS FOR SITE V| KERSHAW COUNTY^ SOUTH CAROLINA* 


Clafg 

Znvantory proportlona 
(radloMatrlc raaolutlon) 

Foraat Sorvloa 

and 8CS 

proportlona 


32« 16, 64, 32 

16, 8, 32, lo 

0i 4| X6f d 


Softwood 

0.247 

0.309 

0.429 

0.510 

Hardwood 

.155 

.254 

.293 

.248 

araaaland 

.027 

.114 

.162 

.036 

Watar 

.010 

.017 

.017 

.022 

Othar 

.542 

.288 

.079 

.184 

Total 

.981 

.982 

.980 

1.000 


county ir«a oquals 2035.54 squaire kilomateti (503 100 «cr«s)< 


TABLE XIV.~ CLASSIFICATION ACCURACY OP 
SEPARABILITY TRAINING FIELDS USING 
INVENTORY SIGNATURES 


clans 

Total 

training 

pixels 

Number 

correctly 

classified 

Percentage 

correctly 

classified 

Site I 

Softwood 

1267 

1053 

83 

Grassland 

548 

232 

42 

Water 

1064 

902 

85 

overall 

2879 

2187 

76* 

Site VII 

Cultivated 

136 

13 

10 

Grassland 

892 

587 

66 

Water 

100 

34 

34 

Overall ° 

1128 

634 

56* 

Site IX 

Softwood 

84 

61 

73 

Hardwood 

304 

250 

82 

Grassland 

260 

170 

65 

Water 

64 

63 

98 

Overall 

712 

544 

76* 


I 

*D«t«r»in«d by dividing tb« nuii of th« corro^tly 
olanalflod plxala by tha total nunbar of plxala. 




7. TECHNICAL PROBLEMS 


M 


Since the purpose of the Ten- 
Ecosystem study was to test the 
applicability of a uniform sot of 
inventory procedures to 10 different 
ecosystems, it is useful to consider 
Ijroblems that were specific to indi- 
vidual sites, as will be done in 
section 7.1, and also problems found 
in the procedures, which will be 
discussed in section 7.2. 


7.1 SITE-SPECIFIC PROBLEMS 

7.1.1. Grand County, Colorado 
(Site I) 

The major problems in analyzing 
data for Site I were related to its 
location in the Rocky Mountains. 

The Rockies receive measurable 
amounts of snow from November 
through May. When snow is on the 
ground, it is impossible to classify 
vegetation. Thus, the season for 
data acquisition is only 5 or 6 
months long, and even during this 
season clouds are frequently a 
problem. 

The high relief causes slope and 
aspect to be a major factor in cor»- 
trolling growth of some vegetation; 
more important, it causes variations 
in illumination. Slope and shadow 
affected accuracies for Level III 
classification more than did species 
variation; however, at Level II, 
slope and aspect did not measurably 
affect class accuracies. For more 
detailed analysis of forest fea- 
tures, some correction must be 
made for slope and aspect effects 
(ref. 15). 


7.1.2 Wanen County, Pennsylvania 
(Site II) 

Because of the scarcity of perma- 
nent landmarks such as road inter- 
sections or stream junctions in the 
heavily forested Site II, an insuf- 
ficient number of control points are 
locatable for good image- to- image 
registration (see fig. 9). Haze 
apparent on this image may have 
contributed to the difficulty in 
locating landmarks. 

7.1.3 St. Louis County, Minnesota 
(Site III) 

The registration of Landsat image 
sets for Site III was difficult 
because of at least two factors. 
The relatively low contrast of the 
radiometric response in the selected 
Landsat scenes made visual identifi- 
cation of control points imprecise. 
Permanent cultural features, such as 
road intersections and dams, which 
are normally used for control points 
were difficult to locate on both 
scenes. Water bodies are plentiful 
in the area, but they do not make 
good features for registration 
because variations in water level 
cause changes in the size and shape 
of the water body. 

Using the Sequential Similarity 
Detection Algorithm rather than man- 
ual input of two sets of control 
points is especially helpful in 
cases like this and the previous 
site. 

7.1.4 Sandoval County, New Mexico 
(Site IV) 

site IV has a great preponderance 
of rock, bare soil, and dry grass 
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Figure 9.— Landsat full-frame image including Warren County, Pennsylvania, 

acquired in September 1972. 


which are typical of aemlarid 
regions. Light-colored rock and 
soil classified as "other" even 
though the actual coverage within a 
pixel may be as much as 50 percent 
scattered pinyon and juniper (see 
fig. 10). When the procedure devel- 
oped for this study is used, a semi- 
arid region with prevalent exposed 
rock will undoubtedly have a major 
portion of the scene categorized as 
"other." 

A spectral clustering procedure, 
such as that used in the reanalysis 


of this site, offers the possibility 
of identifying many of the "other" 
( nonclassif ied) features in the 
site. 

7.1.5 Kershaw County, South Carolina 
(Site V) 

Site V is characterized by small 
clumps or stringers of hardwood, 
softwood, and grassland separated by 
mixtures and transition areas. iMs 
situation makes the development of 
unique class signatures using train- 
ing fields difficult. Acquiring 
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Figure 10.— Pinyon^ juniper with exposed soil snd rock — Site IV 
(Sandoval County, New Mexico). 


cloud-free spring imagery is also a 
problem since cloud- free days aver- 
age only 6 to 8 per month from Janu- 
ary through May. 

7.1.6 Fort Yukon, Alaska 
(Site VI) 

Burns have occurred at one time 
or another over most of Site VI and 
vegetation appears in all stages of 
growth and succession. This causes 
large variations in the spectral 
qualities of the vegetative classes, 
making it difficult to select craln- 
ing fields that will produce broadly 
representative signatures. 

7.1.7 Weld County, Colorado 
(Site VII) 

The scarcity of prominent fea- 
tures for registration, control 
points is a problem at Site VII. 
Changes in land management practices 
between the date of the aerial pho- 
tographs (1972) emd the dates of the 
Landsat image (1974) created some 
confusion for the photointerpreters. 


7.1.8 Grays Harbor County, 

Washington (Site VIII) 

Some very old stands — tall trees 
that have been naturally thinned — 
cast enough shadow to alter their 
spectral signature. These stands 
and the topographic shadow on the 
north- facing slopes were frequently 
classified as water. Clearcutting 
and subsequent regeneration produce 
vegetation with atypical spectral 
signatures which may classify as 
"other." 

7.1.9 Washington County, Missouri 
(Site IX) 

Topographic shadow, which altered 
spectral signatures, was also a 
problem at Site IX. These shadows 
include not only true shadows caused 
by an opaque body but also apparent 
shadows caused by rays from the low- 
angle Sun just grazing rather than 
reflecting from the far side of a 
hill inclined at a similar angle 
(see fig. 11). Approximately 20 
percenL of the western half of the 
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county was affected by the phenom- 
enon of apparent shadow. This prob- 
lem and its effect on classification 
are currently under study. 

Mixtures posed a difficulty as 
the classification map for this site 
may illustrate (fig. 12). An 
attempt to develop a separable 
signature for mixtures of 50 to 80 
percent pine and the rest hardwood 
failed. 

The sampling strategy used in the 
evaluation phase proved to be inade- 
quate. It failed to pick up the 
small and widely distributed stands 
of softwood. sample proportion 
of softwood was less than 3 percent/ 
whereas the complete inventory and 
indeed the county statistics showed 
the softwood proportion to be over 
6 percent. Hardwood was overly rep- 
resented in the s 2 unple proportions. 

The site-specific problems are 
summarized in table XV. Problems 


present at more than one site 
included an inadequate distribution 
of registration control points, 
topographic shadow, highly reflec- 
tive exposed rock, small homogeneous 
areas and large mixture areas, and 
differences in stand age. Problems 
related to the uniform set of proce- 
dures applied to these sites will be 
discussed in the following section. 

7.2 PROCEDURAL PROBLEMS 

Some of the site-specific prob- 
lems just outlined can be traced to 
more general problems in the TES 
procedures. These problems fell 
into two main areas: (I) the 
inflexibility of the procedures, 
which prevented an appropriate 
response to local site characteris- 
tics, and (2) the inadequacy of the 


Figure 12.— Classification map for 
Site IX (Washington County/ 
Missouri ) . 
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TABLE JCV.- PROBLEMS SPECIFIC TO BACH SITE 


Problm ■ource 

Site 


11 

m 

IV 

a 

VI 

Vll 

VllI 


Short Bnow-Cr«e seaBon 

X 

■ 

IjH 

■ 

■ 

■ 



■ 

Frequent cloud c/>ver or haze 

B 




B 




■ 

Scarcity of cultural or topographic 
featurea for ruglatratlon control 
polntB 

1 

1 

D 

1 


1 

H 

H 

1 

Topographic ahadow 

B 



■ 


■ 




Highly reflective featurea or 
undergrowth 

1 

1 

H 

H 


1 

H 


I 

Small homogeneous areas and large 
mixture areas 

1 


H 

■ 

X 

■ 

1 

H 


Differences In stand age due to 
land management and burns 

1 

■ 

1 



■ 

1 


■ 


procedures in the integration of 
mapping and proportion estimation, 
which led to inefficiencies and 
errors. Specifically, basic prob- 
lems occurred in five areas; (1) 
storage and display of data, (2) 
registration of data, (3) system 
parameters used for classification, 

(4) classification flexibility, and 

(5) accuracy assessment of results. 
These problem areas are related to 
each other; for example, the results 
of registration affect classifica- 
tion and accuracy. However, in the 
following discussion, these areas 
will be treated independently. 

7.2.1 Storage and Display of Data 

The size of the TES study site 
(about 60 by 60 kilometers or 37 by 
37 ra,iles) greatly increased the time 
required for input and output of 
data, training signature develop- 
ment, site classification, and pro- 
duction of map displays. Every 
operation had to be performed four 


times. The data storage and display 
of the Image 100 required that the 
site be divided into quadrants for 
classification and then recombined 
for map production. One approach to 
more efficient operations would be 
to limit the size of the study site. 
Another would be to provide in- 
creased storage capacity and more 
flexible display programs. If class 
proportions alone were desired, a 
sampling procedure could be devel- 
oped which did not require the clas- 
sification or display of all pixels. 

7,2.2 Registration 

The data for each site were reg- 
istered three times: image to image 
for the temporal data set, image to 
ground for map products, and image 
to photographs for accuracy assess- 
ment. The residual registration 
errors may have led to reduced clas- 
sification accuracy for the temporal 
data set and to errors in the accu- 
racy assessment. The root mean 
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square error for the individual 
registrations ranged from 1 to 2 
pixels. Thus, the final error for 
the accuracy assessment could be 6 
pixels or more. The rms error is 
computed on the basis of the control 
points used to calculate the trans- 
formation. This may not be an ade- 
quate measure of the registration 
error, and an independent set of 
control points should be used. The 
reduction in the number of data 
transformations could reduce pro- 
cessing time and classification 
error. For example, image- to- ground 
registration is not required in 
order to classify the data and 
assess the accuracy. 

7.2.3 System Parameters 

The Image 100 system required the 
determination of the radiometric 
resolution to be used in processing. 
This usually meant reducing the num- 
ber of levels from 128 to 64 or 32. 
The selection of too high a resolu- 
tion led to underclassification of 
the site as seen in Site V. A more 
appropriate criterion than the vari- 
ance is needed for selection of the 
resolution to be used for process- 
ing. This could include analysis of 
test field areas. On the other 
hand, prograuns that efficiently uti- 
lize the full range in radiance 
could also be used. 

7.2.4 Classification Flexibility 

The selection of training fields 
and the site classification proved 
to be lengthy processes, with a 
varying degree of feature classifi- 
cation accuracy and with large per- 
centages of some sites left unclas- 
sified. To a large extent, these 
problems were due to the use of 


training fields in complex natural 
communities. The training fields 
for a study must be selected both to 
cover all classes of interest and to 
cover the variability of a given 
class. In natural vegetative com- 
munities, in the space between 
"pure" stands, there is considerable 
mixing. Some of these mixtures are 
of interest and others are not. An 
unsupervised classification proce- 
dure would allow for a rapid break- 
down of the site at the most de- 
tailed level, reduce or eliminate 
the need for training field data, 
focus field work on anomalous areas, 
and allow for a more complete clas- 
sification of the study site with 
limited ground-verif ied information. 

7.2.6 Accuracy Assessment 

The TES evaluation procedures 
were designed to assess the overall 
accuracy of the classification map 
and the proportion estimation. 
These procedures did not allow for a 
pixel-by-pixel comparison with the 
ground and the calculation of a con- 
fusion matrix for classes. This 
limitation has led to difficulty in 
interpreting the results of the 
study. In addition, the effect of 
duplicating every third line during 
the image- to- ground registration is 
hard to evaluate. 

An alternative approach, produc- 
tive of more conventional statisti- 
cal results, would be to match clas- 
sification areas to photographic or 
ground- truth areas, make a pixel- by- 
pixel comparison, and develop a con- 
fusion matrix. This approach would 
not require registration, of the 
classification results to the ground 
and thus would eliminate the line 
duplication. 
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8. SUMMARY 


The results of the Ten-Ecosystem 
Study indicate that liandsat multi- 
spectral imagery and associated 
automatic data processing techniques 
can be used to distinguish softwood, 
hardwood, grassland, and water and 
to make inventories of these classes 
with an accuracy of 70 percent or 
better at an estimated operational 
cost of 11 cents per square 
hectometer (5 cents per acre)* The 
potential user would have to decide 
on the cost/benefit ratio, 

The TES experience suggests that 
both efficiency and accuracy would 
be enhanced by postponing geometric 
registration until after classifica- 
tion and its validation. The study 
indicates that training fields can 


be accurately selected from aerial 
photographs. Ground verification 
could then be reserved for accuracy 
assessment, where it was universally 
thought by project scientists to be 
needed. An alternative approach to 
the supervised classification system 
used in TBS would be to apply an 
unsupervised clustering algorithm to 
the spectral data and then identify 
the clusters using an ecologically 
structured hierarchy such as the 
National Site Classification System. 

These findings should be useful 
In determining what improved remote 
sensing inventory procedures should 
be tested by the Multiresource 
Inventory Methods Pilot Study. 
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APPENDIX A 

Classification Maps for Sites Mil and Vl-VIII 

[The classification map for Site IV appears on page 19; 
the map for Site V is on page 15; and that for 
Site IX on page 35.) 
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APPENDIX B 

Proportion Estimates for Sites I, II, and IV-IX 

{The proportion estimates for 
Site III appear on page 18.] 
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APPENDIX B 

PROPORTION ESTIMATES fot SITES I, II# and IV-IX 


TABLE B-I— PROPORTION ESTIMATES FOR 
SITE I, GRAND COUNTY, COLOklVDO 

[Inventory based on Landsat image 
acquired in August 1973] 


class 

Proportion estimate 

Softwood 

0.277 

Hardwood 

.000 

Grassland 

.070 

Water 

.001 

Other 

.. .652 


TABLE B-II.- PROPORTION ESTIMATES 
SITE II, WARREN COUNTY, PENNSYLVANIA 

[inventory based on Landsat image 
acquired in May 1975] 


Class 

Proportion estimate 

Softwood 

0.001 

Hardwood 

.723 

Grassland 

.009 

Water 

.004 

other 

.263 


TABLE B-lII.— PROPORTION ESTIMATES FOR 
SITE IV, SANDOVAL COUNTY, NEW MEXICO 

[Inventory based on Landsat image 
acquired in August 1975] 


Class 

Proportion estimate 

Softwood 

0.087 

Hardwood 

.004 

Grassland 

.061 

Water 

.000 

Other 

.847 


TABLE B-1V.~ PROPORTION ESTIMATES FOR 
SITE V, KERSHAW COUNTY, SOUTH CAROLINA 

[Inventory based on temporal data set 
composed of Landsat images acquired 
in May 1973 and February 1976] 


Class 

Proportion estimate 

Softwood 

0.252 

Hardwood 

.158 

Grassland 

.028 

Water 

.010 

Other 

.552 
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TAfJLE B-V— PROPORTKW ESTIMATES FOR 
SITE VI, FORT Yl'iKON, ALASl<A 

[Inv«nt:ory based on temporal data set 
composed of Land&at images acquired 
in September 1973 and August 1976) 


Class 

Proportion estimate 

Softwood 

0.278 

Hardwood 

.124 

Tundra 

.277 

Water 

.011 

Other 

.310 


TABLE B-VI.— PROPORTION ESTIMATES FOR 
SITE VII; HELD OOUNTV; COLORADO 

[Inventory based on Landsat image 
acquired in July 1974) 


Class 

Proportion estimate 

Cultivated 

0.034 

Grassland 

.504 

Other 

.462 


TABLE B-VII.- PROPORTION ESTIMATES 
FOR SITE VIII, 

GRAYS HARBOR COUNTY, WASHINGTON 

[Inventory based on Landsat image 
acquired in September 1974] 


Class 

Proportion estimate 

Softwood 

0.544 

Hardwood 

.082 

Clearcut 

.016 

Water 

.020 

Other 

.337 


TABLE B-VIII— PROPORTION ESTIMATES FOR 
SITE IX, WASHINGTON COUNTY, MISSOURI 

[inventory based on Landsat image 
acquired in July 1974] 


Class 

Proportion estimate 

Softwood 

0.068 

Hardwood 

.445 

Grassland 

.098 

Water 

— 

Other 

.388 
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Detailed Cost Tables for the 
Ten-Ecosystem Study 




APPENDIX C 


DETAILED COST TABLES tot bh« TEN-ECOSYSTBM STUDY 


TABLE C-I.— ESTIMATED DIRECT COSTS FOR RESEARCH 


Site 

number 

Site 

location 

Labor* 

Materials^ 

Travel 

Computer 
access I 

Total 

I 

Grand County, 
Colorado 

$20 

823 

$1 

200 

$1 

145 

$36 

365 

$59 

533 

11 

Warren County, 
Pennsylvania 

13 

145 

1 

200 

1 

402 

29 

160 

44 

907 

til 

St. Louis County.. 
Minnesota 

18 

854 

1 

200 

1 

487 

54 

315 

75 

856 

IV 

Sandoval County, 
New Mexico^ 

21 

373 

1 

200 

1 

210 

41 

475 

65 

258 

V 

Kershaw County, 
South Carolina 

16 

313 

1 

200 

1 

406 

30 

185 

49 

104 

VI 

Fort Yukon, 
Alaska 

18 

084 

1 

200 

7 

354 

32 

195 

64 

833 

VII 

Weld County, 
Colorado 

18 

920 

1 

200 

1 

063 

61 

120 

82 

303 

VIXI 

Grays Harbor County, 
Washington 

le 

711 

1 

200 

1 

866 

31 

515 

53 

292 

IX 

Washington County, 
Missouri 

13 

046 

X 

200 


887 

30 

750 

45 

883 

Mean 


$17 

697 

$1 

200 

$1 

980 

$38 

564 

$60 

108 


*Hourly rate inflated to $11 per hour fror,< the Energy Research and Development 
Agency (ERPA) 1976 estimate of $9.95 for scientific hourly rate in 1976. 

^Materials purchased by negotiated subcontract covering all sites, therefore 
prorated to each site. 

^Calculated at rates of $300 per hour for interactive console, $125 per hour for 
batch, and $15 per hour for digitizing. Rates estimated by informal government 
sources. 

^Por the original study only. A rework of this effort designed to explore 
applications of the NSCS is not included. 
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TABLE C-II.— ESTIMATED IffiSEARCH DIRECT COSTS PER UNIT AREA 
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TABLE C-ni.- ESTIMATED DIRECT COSTS FOR APPLICATIONS 


Site 

Labor 

Materials 

Travel 

Computer 

access 

Total 

I 

$13 

743 

$1 

200 

$l 

145 

$18 

— 

183 

$32 

271 

II 

8 

676 

1 

200 

1 

402 

14 

580 

25 

858 

III 

12 

444 

1 

200 

1 

487 

27 

158 

42 

289 

IV 

14 

106 

1 

200 

1 

210 

20 

738 

37 

254 

V 

10 

767 

1 

200 

1 

406 

15 

093 

28 

466 

VI 

11 

935 

1 

200 

7 

354 

16 

098 

36 

587 

VII 

12 

487 

1 

200 

1 

063 

30 

560 

45 

310 

VIII 

12 

349 

1 

200 

1 

866 

15 

758 

31 

173 

IX 

8 

610 

1 

200 


887 

15 

375 

26 

072 

Mean 

$11 

680 

$1 

200 

$1 

980 

$19 

283 

$34 

142 


TABLE C-IV.— ESTIMATED APPLICATIONS DIRECT COSTS PER UNIT AREA 


— 

Site 

Approximate 

cost 

Approximate area 
classified 

Approximate cost per 
unit area 

2* 

hm^ 

acre 

hm^* 

acre 

I 

$32 300 

310 000 

765 000 

$0.10 

$0.04 

II 

25 900 

381 000 

941 000 

0.07 

0.03 

III 

42 300 

316 000 

781 000 

0.13 

0.05 

IV 

37 300 

310 000 

765 000 

0. 12 

0.05 

V 

28 500 

204 000 

503 000 

0.14 

0.06 

VI 

36 600 

314 000 

776 000 

0. 12 

0.05 

VII 

45 300 

305 000 

754 000 

0. 15 

0.06 

VIII 

31 200 

304 000 

751 000 

0. 10 

0.04 

IX 

26 100 

297 000 

734 000 

0.09 

0.04 

Mean 

$34 100 

304 000 

752 000 

$0. 11 ' 

$0.05 


it 0 • 

hm (hectometer) is equivalent to 1 hf;Stare. 




TABLE C-V,- SAMPLE MODEL AND DATA SOURCE TABLE 
FOR DETERMINING TOTA^ PROJECT COSTS 


K I * », 


C» (H • r-K »+M+T+ V)« . g * p 
Sourot table] 


Symbol 

Description 

Source or rate 

C 

Total ^project cost 


K 

Hours worked 

Individual worklogs 

r 

Average hourly pay rate 

$11*00^ 

s 

Manufacturing overhead 
factor 

1*50'^ 

H 

Cost of materials 

Filled purchase requests 

T 

Travel costs 

Expense reports 

V 

Other direct costs 

Receipts, computer logs 

e 

Engineering overhead 
factor 

1*10 

g 

General and administrative 
expense factor 

1*05^ 

p 

Profit factor 

p' + 1*09* 


p' 0*12W + 0*05S + 0*03D 

h 0*08E t 0*076G 


W + S t D ■ 

E + G 

w 

Wages 

H * r 

s 

Manufacturing overhead 

W(s - 1) 

D 

Direct costs 

M + T + V 

E 

Engineering overhead 

(W * a + D)(e - 1) 

G 

General and administrative 
costs 

(W * s + D) e (g - 1) 


« 

Trueger, P. M. ; Accounting Guide for Defense Contracts, 6th ed* 
Commerce Clearing House (Chicago), 1971* 

^ERDA 1976 estimate, adjusted to 1978 estimate* 


Estimates derived from various readings* 
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TABLE C-VI.~ RESULTS TABLE FOR TOTAL RESEARCH AND 
APPLICATIONS FOR THE MEAN OP TES SITES 


Symbol* 

Description 

Research^ 

Applications^ 

W 

wages 

$17 697 

$11 680 

S 

Manufacturing overhead 

$8 849 

$5 840 

M 

Cost of materials 

$1 200 

$1 200 

T 

Travel costs 

$1 980 

$1 980 

V 

Other direct costs 

$38 564 

$19 283 

E 

Engineering overhes'jl 

$6 829 

$3 998 

G 

General and administrative 
expense 

$3 756 

$2 199 

P 

Profit 

$11 752 

$7 019 

C 

Total project costs 

$90 627 

$53 199 


♦symbol formulas are given In table C-V# 

"calculated using the sample model given In table C-'V. 



Dii-eot cost for site analysis 

Figure Comparison of direct coat for site 

dnatysie with relative analyet ADP experience* 
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Direct cost for site analysis 


liguve 0-2 •- Comparieon of direct coat for eite 
analyaia with proportion of foreat in site* 



Direct cost for site analysis 


Figure C-S,~ Compariaon of direct coat for aite 
analyaia with proportion of hardwood in aite. 
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Direct cost for site analysis 


90 


Figure C-4,- Comparieon of direct coat for site 
amlyeie with proportion of softwood in site. 



Figure C-6.~ Comparison of direct cost for site analysis 
with proportion of grassland or tundra in site. 
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APPENDIX D 

Summary of Class Proportion 

Errors for Sites I-VIII ij 

{The summary of class proportion errors for 

Site TX appears on page 27.] H 

;i 
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APPENDIX D 





SUMMARY of CLAS^ PROPORTION ERRORS for SITES I-VIII 

TABLE D-I— SUMMARY OP CLASS PROPORTION ERRORS FOR SITE I, 
GRAND COUNTY, COLORADO 


Class 

Inventory class 
proportion, 

A 

P 

Photograph class 
proportion, 

P 

Average 

error, 

B 

90-percent 

confidence 

interval 

Hardwood* 





Softwood 

0,4275 

j 

0.531 

0.1035 

(0.0596, 0.1474) 

Grassland 

.055 

.056 

.001 

(-.0227, .0247) 

Water 

.005 

.0065 

.0015 

(-.0009, .0039) 

Other 

.5125 

.4063 

-.1062 

(-.143, -.069) 


* 

Extensive hardwood sites did not occur in the area from which signatures 
were extracted? therefore, this class was not considered for this portion 
of the evaluation. 


TABLE D-Il— SUMMARY OF CLASS PROPORTION ERRORS FOR SITE II, 
WARREN COUNTY, PENNSYLVANIA 


Class 

Inventory class 
proportion, 

P 

Average 

error, 

B 

90-percent 
conf idence 
interval 

Significance 
of error 

Hardwood 

0.770 

0.009 

(-0.003, 

0.029) 

None 

Softwood 

.002 

.013 

( -.002, 

.028) 

None 

Grassland 

.014 

-.003 

( -.012, 

.006) 

None 

Water* 






Other 

.214 

-.019 

( -.050, 

.013 

None 


* 

None in test area. 
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TABLE D-III.- SUM^IARY OF CLASS PROPORTION ERRORS FOR SITE III, 
ST. LOUIS COUNTY, MINNESOTA 

, ■ I 


Class 

Inventory 

class 

proportion , 

«s 

P 

Photograph 

class 

proportion, 

P 

Average 

error, 

B 

Standard 
deviation 
of error, 

Sb 

Softwood 

0.263 

0.282 

0,019 

0.014 

Hardwood 

.331 

.406 

*075 

.015 

Grassland 

.058 

.062 

.004 

.014 

Water 

.132 

.148 

.016 

.008 


t. 


Class 

Half the 
confidence 
interval at 
the 90-percent 
level* 

Confidence 
interval, 
B ± A 

Does 

Interval 

contain 

zero? 

Percent 

relative 

error, 

RB 

Agreed or 
over/under 
estimate 

Softwood 1 

1 

0.024 

(-0.004, 

0.044) 

Yes 

7.07 

Agreed 

Hardwood 

.025 

( .050, 

.100) 

No 

19.47 

Under 

Grassland 

.024 

• 

O 

ro 

.028) 

Yes 

6.47 

Agreed 

Water 

.013 

{ -.003, 

.029) 

Yes 

10.81 

Agreed 


Aq, 9 “ 1.729Sg. 
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TABLE D-IV— SUMMARY OF CLASS PROPORTION ERRORS FOR SITE XV, 
SANDOVAL COUNTY, NEW MEXICO 


Inventory 11 PSU's 


class 

Inventory class 
proportion, 

A 

P 

Photograph class 
proportion, 

P 

Average 

error, 

B 

90 -percent 
confidence 
interval 

Softwood 

0.132 

0.164 

0.032 

(0.001, 0.063) 

Hardwood 

.011 

.011 

-.0004 

(-.031, .031) 

Grassland 

.091 

.096 

.005 

(-.005, .015) 

Water* 



1 


Other 

.766 

.729 

-.037 

(-.07, -.004) 


Inventory 20 PSU's 


Class 

Inventory class 
proportion, 

A 

P 

Photograph class 
proportion, 

P 

Average 

error, 

B 

90-percent 

confidence 

interval 

Softwood 

0.21 

0.234 

0.024 

(-0.001, 

0.049) 

Hardwood 

.016 

.018 

.002 

(-.001, 

.005) 

Grassland 

.05 

.053 

.003 

(-.003, 

.009) 

Water* 






Other 

.724 

.695 

-.029 

(-.054, 

-.004) 


*None in test area. 















TABLE D-V.— SUMMARY OF CLASS PROPORTION ERRORS FOR SITE V, 
KERSHAW COUNTY, SOUTH CAROLINA 


Class 

Inventory class 
proportion, 

A 

P 

Motograph class 
proportion, 

P 

Average 

error, 

B 

90 -percent 
confidence 
Interval 

Softwood 

0.314 

0.371 

0.057 

(0.021, 

0.093) 

Hardwood 

.222 

.291 

.069 

( .036, 

.108) 

Grassland 

.042 

.039 

-.003 

(-.025, 

.019) 

Water 

.015 

.018 

.003 

(-.005, 

.011) 

Other 

.407 

.278 

-.129 

(-.167, 

.091) 


TABLE D-VI.~ SUMMARY OF CLASS PROPORTION ERRORS FOR SITE VI, 

FORT YUKON, ALASKA 


Class 

Inventory class 
proportion, 

A 

P 

Photograph class 
proportion, 

P 

Average 

error, 

B 

90 -percent 
confidence 
.1 . interval 

Softwood 

0.358 

0.338 

-0.020 

(-0.052, 

0.012) 

Hardwood 

..102 

.142 

.040 

( .019, 

.061) 

Tundra 

.268 

.276 

.008 

( -.021, 

.037) 

Water 

.005 

.008 

.003 

( -.002, 

.008) 

Other 

.267 

.236 

-.031 

( -.055, 

-.007) 
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TABLE D-VII.- SUMMARY OP CLASS ‘ PROPORTION ERRORS POR SITE VII, 

WELD COUNTY, COLORADO 


Class 

— 

Inventory 

class 

proportion, 

P 

Photograph 

class 

proportion, 

P 

Average 

error, 

B. 

Standard 
deviation 
of error, 

Sb 

Cultivated 

0.022 

0.050 

0.028 

0.025 

Weeds 

0 

.027 

.027 

.023 

Grassland 

.543 

.441 

-.102 

.050 

Water* 





Other 

.435 

.482 

.047 

.052 


Class 

Half the confidence 
interval at the 
90-percent level, 

^0.9 

Conf idence 
interval, 
B i A 

Percent 
relative 
error , 
RB 

Cultivated 

0.047 

(-0.019, 

0.075) 

56 

Weeds 

.035 

( -.008, 

.062} 

100 

Grassland 

.091 

( -.193, 

-.011) 

23.1 

Water* 





Other 

.096 

( -.049, 

.143) 

9.75 


There were no significant water bodies in this site. 









TABLE D-VIli,— SUMMARY OP GLASS PROPORTION ERRORS FOR SITE VIII, 
GRAYS HARBOR COUNTY, WASHINGTON 


Clasa 

Inventory class 
proportion, 

A 

p 

Photograph class 
proportion, 

P 

Average 

error, 

B 

90-percent 

confidence 

interval 

Softwood 

0.584 

0.614 

0.030 

(-0.018, 

0.078) 

Hardwood 

.074 

.103 

.029 

( -.004, 

.062) 

Clearcut 

.032 

.070 

.038 

( .007, 

.069) 

Water 

.004 

.004 


{ -.008, 

.008) 

Other 

.306 

.209 

-0.097 

( -.137, 

-.057) 
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APPENDIX E 


Regression Estimates for 
Sites I, IV, and VI-IX 


[The regression estimates for 
Site III appear on page 28.] 


APPENDIX E 


REGRESSION ESTIMATES for SITES t, IV, and VI-IX 


TABLE B-I.~ REGRESSION ESTIMATE OP SOPTWOOD ACREAGE 
FOR SITE I, GRAND COUNTV, COLORADO 


Coefficient of 
determination, 
r2 

Regression 

equation 

standard 

error, 

S 

0.77 

■p « + 0.10 

0.031 




TABLE E-II,-. REGRESSION ESTIMATES OF PROPORTIONS AND ASSOCIATED 
PRECISION FOR SITE IV, SANDOVAL COUNTY, NEW MEXICO 


Class 

Simulated 

inventory 

proportion, 

A 

P 

Photograph 

proportion, 

P 

Significance 
of difference 
(p - p) 

Level of 
significance 

Softwood 

0.21 

0.234 

No difference 

0.01 

Grassland 

.091 

.096 

No difference 

.01 


Glass 

Coefficient of 
determination, 
r^ 

Regression 

equation 

Standard 

error* 

PSU's 

Softwood 

0.92 

P * 1-llPinv 

+ 0.0005 

2.0 

20 

Grassland 

.97 

p » 0.98p^j^y 
+ 0.01 

1.02 

11 


* 


Standard error = 


lOOO g; 
7 , ' 


where N is the number of PSU's. 


irs;-, --Ml.' 
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TABLE E-IZI.- REGRESSION ESTIMATES OF PROPORTIONS AND 
ASSOCIATED PRECISION FOR SITE VI, FORT YUKON, ALASKA 


Class 

Simulated 
Inventory 
proportion , 

^inv 

Regression 

equation 

Regression 

estimate, 

P 

Coefficient of 
determination, 
r2 

Softwood 

0.2794 

P - O'SSPinv 
+ 0.019 

0.2675 

0.90 

Hardwood 

.1243 

- 0.88p^„y 

+ 0.052 

.1612 

.83 

Tundra 

.2767 

? - 0.94Pi„^ 
+ 0.023 

.2846 

.83 

Water 

.0108 

r - 

+ 0.0004 

.03283 

.64 


Class 

Variance of the 
regression 
estimate, 

S2 

Half the confidence 
Interval at the 
90-percent level 

^0.9 

Percent 

relative 

variation, 

^).9 “ 

Softwood 

0.00343 

0.031695 

11.9 

Hardwood 

.000148 

.020795 

12.9 

Tundra 

.000308 

.030045 

10.6 

Water 

.000011 

.005618 

32.1 




I’ABIiB B-IV— REGRESSION ESTIMATES OP PROPORTIONS AND ASSOCIATED 
PRECISION FOR SITE VII/ WELD COUNTY, COLORADO 


class 

Simulated 
inventocy 
proportion , 

^Inv 

Regression 

equation 

Regression 

estimate, 

P 

Coe £fic lent of 
determination, 

Caltelyabed 

0.034 

;p « 2.X85p£^y 
+ 0.0018 

0.076 

0.632 

Gtassland 

.504 

p » O.SlOpj^ 

- 0.0045 

.409 

.727 

Othet 

.460 

» 0.7325Pij,y 
+ 0.1634 

.500 

.628 


Class 

Variance of the 
regression 
estimate , 

Half the confidence 
interval at the 
90-percent level 

^0.9 

Percent 
relative 
variation, 
Aq.9 X 100 

Cultivated 

0.000483 

0.040 

52.81 

Grassland 

.002318 

.088 

21.60 

Other 

.002329 

.088 

17.69 


i 
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TABLE E-V.~ REGRESSION ESTIMATES OP PROPORTIONS 
AND ASSOCIATED PRECISION FOR SITE VIII « 
GRAYS HARBOR COUNTY, WASHINGTON 


Class 

Simulated 

inventory 

proportion, 

Pinv 

Regression 

estimate, 

P 

Coefficient of 
aeter.Jn.tion, 

Softwood 

0.544 

0.579063 

0.64574 

Hardwood 

.074 

.111653 

.46374 

Clearcut 

.032 

.057966 

.20448 

Water* 

.004 

.002032 

.00497 

Water t 

.020 

.020 

0 


Class 

Variance of the 
regression 
estimate, 
s2 

Half the confidence 
interval at the 
90-percent level 

^0.9 

Percent 
relative 
variation, 
Aq.9 X 100 

P 

Softwood 

0.00Q817 

0.049 

8.45 

Hardwood 

.000410 

.035 

31.03 

Clearcut 

.000352 

.032 

55.43 

Water* 

.000046 

.012 

558*9 

Water^ 

.000063 

1 

67.76 


A 

^ Unconstrainesd regrerjsion. 

'^Regression with intercept through origin. 








TABLE E-VI.— REGRESSION ESTIMATES OF PROPORTIONS AND ASSOCIATED 
PRECISION FOR SITE IX, WASHINGTON COUNTY, MISSOURI 


Class 

Simulated 

inventory 

proportion, 

Pinv 

Regression 

equation 

1 

Regression 

estimate, 

P 

Coefficient of 
determination, 

Softwood 

0.0681 

?r » 0.725p^„^ 
+ 0.011 

0.060 

0.390 

Hardwood 

.4451 

? - 0.330p^„^ 
+ 0.610 

.757 

.174 

Grassland 

.0980 

P = 0-417pV^ 
+ 0.039 

.080 

.278 


Class 

Variance of 
the regression 
estimate, 

S2 

Half the confidence 
intervai at the 
9’0 -percent level 

^0.9 

Percent 
relative 
variation ; 
A„.9 « 100 

Softwood 

0.000261 

0.030 

49.4 

Hardwood 

.007809 

.162 

21.4 

’ 

1 Grassland 

.000326 

.030 

41.4 
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APPENDIX F 

Comparisons of Ten-Ecosystem Study Results With 
Published Figures for Sites I, II, IV, and IX 

[A comparison for Site V is presented on page 30.] 
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appendix f 


COMPARISONS OF TEN-ECOSYSTEM STUDY RESULTS WITH 
PUBLISHED FIGURES FOR SITES I, II, IV, AND IX 


TABLE F-I.- SOFTWOOD AREA ESTIMiVTES AND COMPARISON FOR 
SITE I, GRAND COUNTY, COLORADO 


Softwood area estimates 

Fraser Township 

Square 

kilometers 

Acres 

Forest Service stand map* 

67.48 

16 678 

Photointerpretatlon^ 

70.04 

17 310 

ADP pixel count 1* 

67.77 

16 751 

Corrected (regression) estimate 

60.50 

14 952 

Adjusted standard error of 
regression estimate^ 

2.33 

576 

Confidence interval of 
regression estimate (0.9 level )^ 

(56.47, 

64.53) 

(13957, 

15949) 

Total area inside unit 

95.52 

23 607 


*Forest Service stand map over township was measured by a 
planlmeter; stand map was more than 5 years old. 

^Area measured by planlmeter using Interpreted overlays 
of 1:120 000-,vcale color-infrared photographs (not corrected 
geometrically); photographs were taken in September 1972. 

^ ADP of August 1973 Landsat data, using signatures developed 
in the separability study. 

S 

'Precise standard error depends on how different the area to 
be corrected is from the average area used in the regression 
analysis. Adjusted standard error (ASE) relates to standard 
error (SE) by the equation 

(AS)E)^ = (SE)^[1 + n(pQ - P)^/E(P - P)^] 

where n - number of data po.-'nts In regression 
pQ = the area to ' be corrected 

P = area (data value) of regression data 

V P “ average of P 

Confidence interval = t(ASE), where the value of t is taken 
from a statistical table. 



TABLE HARDWOOD AREA ESTIMATES AND COMPARISON FOR 

SITE II, WARREN COUNTY, PENNSYLVANIA 


— 

Condition 

May estimates 

September 

Inventory 

estimate 

Forest Service 
survey figures* 

Separability 

Inventory 

Hardwood proportion 

0.773 

0.77 

0.488 

0.794 

Area , square kilometers 
(acres) 

1821.88 
(450 196) 

1814.80 
(448 447) 

1150.16 
(284 211) 

1870.46 
(462 200) 

Differs from 
Forest Service survey 
area , percent 

-2.60 

-2.98 

-51.20 

0 


* 


Ferguson, R. H. : The Timber Resources of Pennsylvania. Northeastern Forest 

Experiment Station, USDA Forest Service (Upper Darby, Pa.), 1968. 


TABLE F-III .- COMPARISON BETWEEN ADP CLASSIFICATION AND MEASURED 
FEATURES FOR TOWNSHIP 17 NORTH, RANGE 2 EAST, 

SITE IV, SANDOVAL COUNTY, NEW MEXICO 


Class 

ADP 

classlf Ication 

Measured features 

A* 

Pixels 

Square 
kilometers 
( acres ) 

Percent 

total 

area 

Square 

kilometers 

(acres) 

Percent 

total 

area 

Softwood 

335 

1.10 

1.16 

1.49 

1.60 

0.44 



(272) 


(368) 



Hardwood 

2 

.008 

0 

.29 

.31 

.31 



(2) 

• 

(72) 



Grassland 

444 

1,46 

1.54 

1.60 

1.72 

.18 



(361) 


(395) 



Water^ 







Other 

27 996 

92.11 

97.30 

89.89 

96.37 

.93 



(22 761 ) 


(22 212) 



Total ^ 

28 777 

94.67 

100 

93.27 

100 




(23 395) 


(23 048) 




* 

A = measured features - ADP classification. 

^None in test area. 

^The difference in the total area is i.52 percent. 
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TAELE F-IV.— SIMULATED INVENTORY VERSUS WASHINGTON COUNTY STATISTICS 
[Class proportions based on pixel count] 


Data source 

Level II class 

Other 

1 

Total area, 
including water 

Softwood 

Hardwood 

Grassland 

Simulated inventory: 





■■■IH 

Proportion 

0.0681 

0.4451 

0.0980 

0.3888 


Square kilometers 

136.06 

889.83 

195.87 

777.20 

1998.58 

Acres 

33 620 

219 800 

48 400 

192 050 

493 860 

County statistics:* 






Proportion 

0.0622 

0.6743 

0.1399 

0.1236 

1.00 

Square kilometers 

122.62 

1330.20 

275.96 

239.57 

1972.60 

Acres 

30 300 

328 700 

68 190 

59 200 

487 440 

Proportion error 

0.0059 

-0.2292 

-0.0419 

0.2652 

0.013 


*County statistics obtained from Essex, Burton L * 7 and Spencer, John C«, 
Jr.: Timber Resource of Missouri's Eastern Ozarks, 1972. North Central 

Forest Experiment Station, USDA Forest Service (St. Paul, Minn.), 1974. 














